Turn Hand Rehab into Melody
Patients play a melody with prescribed hand-rehab movements, hear deviations as they practice, and leave with a progress record their therapist can review at follow-up.
People recovering from a hand injury, surgery, or neurological condition often have to count through repeated exercises at home without knowing whether their range of motion meets the target. A therapist records target ranges for flexion, extension, rotation, or opening and closing movements in the plan. After positioning a phone and putting on headphones, the patient uses the prescribed movements to play a simple melody. Each session begins with that day’s pain and fatigue level, rather than automatically reusing the previous session’s workload.
When movement reaches the target range and remains steady enough, the melody stays harmonious and continuous. If the movement is too fast, does not reach the required range, or shows clear compensation, the sound becomes unstable. Patients can hear deviations as they move instead of watching the screen for the right angle. The screen shows only essential cues: whether to slow down, pause, or switch movements.
At the end of a session, the system produces a short report with repetitions completed, range of motion, steadiness, and patient-marked changes in pain. Before a follow-up appointment, patients can share several weeks of results with their therapist, who can then adjust the next phase’s goals. Raw video stays on the device by default unless the patient chooses to send it.
The product does not diagnose conditions or replace a therapist’s rehabilitation prescription. The first version focuses on a small set of basic hand movements and short melodies, turning repetitive practice into a piece of music that can be played more completely week by week as recovery progresses.
Why now
As of August 7, Gesture Synth School ranks 12th in Product Hunt’s new-product feed, giving gesture-driven music practice visible exposure. S1 This makes the idea easier for patients to grasp: rehabilitation movements can be corrected through sound in real time, without watching angles on a screen.
Target user
People recovering from hand injuries, surgery, or neurological conditions. The key moment is after a therapist has prescribed home exercises, but the patient must repeat them alone. Pain, fatigue, and compensatory movement can vary day to day. Patients need immediate feedback without watching a screen, while therapists need trends they can scan quickly before follow-up.
Minimal entry point
Start with a mobile web prototype using MediaPipe Hand Landmarker. It can return hand landmarks from video frames, making it suitable for calculating relative finger-joint angles and opening-and-closing trajectories. S2 Each session begins by calibrating a neutral position and comfortable range of motion. Movement range is then assessed against thresholds set by the therapist. The first version covers flexion, extension, and opening and closing, not complex rotation. Short-window smoothing distinguishes tremor, overly rapid movement, and pauses. Deviations can then map to pitch, harmony, or tempo. Raw video remains on-device; only repetitions, range, steadiness, and self-reported pain are exported.
Punching above its weight
Recruit the first users through post-operative hand-surgery follow-ups and the existing patients of hand and occupational therapists. Offer a no-install camera demo where therapists set thresholds themselves and hear the feedback. Acquisition content can demonstrate how the sound differs for insufficient range, excessive speed, and stable completion. The follow-up report template can become a natural referral channel for therapists to send to patients.
Competitors & gaps
- ReHandGoogle
- ReHand already covers wrist, hand, and finger rehabilitation, with personalized exercises prescribed by professionals. It also offers video and voice guidance, plus progress dashboards. S3 Its exercises adapt to patient limitations and emphasize pain-free, staged progression. Its public materials center on tablet-based touch and movement tasks, addressing prescription delivery, adherence, and remote review. There is no apparent feature that continuously maps free-space finger range of motion to melodic harmony, or that uses headphones as the primary feedback channel so patients can look away from the screen. The opening is to turn therapist-set targets into an audible, real-time error signal while retaining only a brief follow-up summary. But that opening exists only if camera measurements are stable and the audio does not induce incorrect movement patterns.
How it makes money
Charge clinics or therapist seats a monthly fee that includes patient exercise plans, report sharing, and basic data management. Patients use the app free with a prescription.
The case against
A single phone camera is vulnerable to occlusion, lighting, and device placement. Landmark errors also become more common when fingers overlap. S2 If incorrect audio feedback occurs frequently, patients may alter their movement to chase harmony and even develop new compensations. Therapists must also set thresholds for different injuries and explain when to stop if pain or fatigue worsens. Regulatory assessment becomes substantially heavier if range results are presented as clinical measurements or the system offers treatment recommendations. S4 Before proceeding, validate repeat-measurement consistency, stopping rules, and a human review process for abnormal movements.