tapwithus/tap-python-sdk/tap-dpad

Claude Code and agent skill by tapwithus/tap-python-sdk

Trust tier 2
  • community
LLM review pending
Source check pending

Checking that the SKILL.md file is still in the repository.

Build a D-Pad style controller with a Tap - swipes for directions, short pinches to select, pinch-hold that locks into rotate (twist) or drag (move) mode, fist-hold to hide. Use for D-Pad, menu navigation, select and move, drag and drop, rotate objects, or game controls with gestures.

Install

npx vskill@latest install tapwithus/tap-python-sdk/tap-dpad

SKILL.md

D-Pad (swipe, pinch, hold to rotate or drag)

Needs the TapXR developer firmware or TapBand: air gestures and IMU motion. TapBand uses the same BLE API and is coming soon. This is the same interaction as the D-Pad page in the TAP_EV sandbox (https://tapwithus.github.io/TAP_EV/).

Interaction

User doesCodesEvent
Swipe left / right / up / down101-104("direction", "left") ...
Short pinch thumb + index / middle / ring / pinky105-108 (AB-AE)("pinch", 0..3) (only when nothing is held)
Hold a pinch110-113("hold", i), mode pending
...and twist 25° or more within 1 sIMU roll("mode", "rotate"), then ("rotate", degrees)
...and do not twist-after 1 s ("mode", "drag"), then ("drag", dx, dy)
Relax the hand4 x 100 (NONE)("release", i): snap back or drop the item
Hold a fist114("hide",); then 2 x NONE gives ("show",)

Repeats of the same code within 40 ms are ignored (gesture packets stream continuously).

mermaid
stateDiagram-v2
  idle --> pending: pinch hold
  pending --> rotate: roll travel >= 25 deg
  pending --> drag: 1 s without enough roll
  rotate --> idle: 4 x NONE
  drag --> idle: 4 x NONE
  idle --> hidden: fist hold
  hidden --> idle: 2 x NONE

Use the template

Copy scripts/dpad.py. It has:

  • DpadStateMachine: pure logic, no Bluetooth. All methods take now in seconds (time.monotonic()) and return a list of event tuples.
  • on_gesture(code, now): feed air-gesture codes.
  • on_motion(dx, dy, roll, now): feed IMU motion.
  • tick(now): optional; locks drag mode on time if motion packets stop.
  • held, mode, hidden: current state for drawing the UI.
  • main(): connects, checks for set_feature, enables features, prints events, and buzzes on hold / mode lock / pinch.

Required device setup (after await sdk.start()):

python
await sdk.set_feature(DeviceFeatures.MODEL_DETECTION, True)
await sdk.set_vision_sensor_model(ModelTypes.AIR_GESTURE)
await sdk.set_vision_sensor_op_mode(VisionSensorOpModes.STREAM)
await sdk.set_feature(DeviceFeatures.IMU_MOTION_DATA, True)

Tuning

ArgumentDefaultEffect
rotate_lock_deg25Roll travel needed to choose rotate. Raise it if drag is chosen too rarely.
lock_window_s1.0Time to decide between rotate and drag.
release_after4NONE packets before release.
show_after2NONE packets after a fist before showing again.
debounce_s0.040Ignore repeats of the same code in this window.
  • drag deltas are raw device units. Multiply by a gain (TAP_EV uses about 0.45 px per unit) and clamp to the screen.
  • rotate gives degrees relative to the start of the hold. TAP_EV multiplies by 1.8 for a stronger visual turn.
  • If a drag should not stay after release, snap the item back on ("release", i) (TAP_EV does this).

Ideas

  • Browser game: 4 shapes, each selected by its pinch; hold to rotate or move it. Use the WebSocket bridge from tap-build-an-app.
  • Menu: swipes move focus in a grid, pinch AB = OK, pinch AC = back, fist = close.
  • Photo viewer: swipes = next / previous, hold + twist = rotate, hold + drag = pan.

See also tap-knob (hold + twist for values) and tap-vision-models (all gesture codes).

Security

  • Security scanPassed, 100 of 100Pattern checks on the skill's files.
  • Model reviewNot runA model review is scheduled for the next rescan.

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

7-day trend score
0

Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/tapwithus/tap-python-sdk/tap-dpad/badge)](https://verified-skill.com/skills/tapwithus/tap-python-sdk/tap-dpad)

Something wrong with this skill or its page? Tell us.