Kenyan Sign Language Justice Counter Interpreter

At Kenyan justice-service counters, KSL users can confirm a sign-language back-translation before their message is spoken aloud, leaving a verifiable bilingual record.

When a Deaf Kenyan needs to explain a situation at a police station, court counter, or legal-aid office, they sign in Kenyan Sign Language (KSL) in front of a counter tablet. The camera captures signing, body position, and facial expressions—the grammatical signals the system needs. A transcript first appears on screen, then a sign-language animation plays back the intended message for the signer to confirm.

Only after the user selects “meaning is correct” does the system play the message aloud in Swahili or English for the counter staff, while displaying the text. If recognition confidence is low for a segment, the interface highlights it and asks the user to repeat it or type instead. For complex legal wording, staff can call a remote human interpreter with one tap rather than letting the machine guess.

After the conversation, both sides can export a bilingual summary with timestamps, the original content, confirmation records, and translations. Deaf users can choose to save it only on their own device or share it with a lawyer, legal-aid organization, or a later case-handling counter for verification. Staff can see only what is needed for the current exchange, not the person’s full history of requests.

The first version focuses on high-frequency counter conversations: appointments, incident reports, document submission, and rights notifications. It initially supports short KSL exchanges into English and Swahili. It does not replace certified interpreters, provide legal advice, or treat an unconfirmed machine translation as a formal statement.

Why now

On June 26, Kenya’s National Assembly passed amendments to the Kenyan Sign Language Bill, which would strengthen responsibilities for sign-language services in courts and public institutions. S1 On July 25, a request for an app addressing the justice system’s lack of interpreters received 361 likes, 134 reposts, and 10,400 cumulative views, bringing the gap in short counter exchanges and user confirmation into focus. S2

Target user

The core users are KSL signers visiting a police station, court counter, or legal-aid office alone. They especially need to confirm what staff understood when reporting an incident, submitting additional documents, or first receiving a rights notification. A changed subject, time, or negation in a single sentence can affect what happens next. Counter staff and remote interpreters are collaborative users who need to see the original segment, confirmation status, and reason for human handoff.

Minimal entry point

Build the counter experience as an offline-first tablet web app using the browser camera. MediaPipe Holistic Landmarker can extract landmarks for both hands, body pose, and face, providing an input layer for signing features. S3 KSL users and legal interpreters should jointly record the training data, limited to short phrases for appointments, incident reports, document submission, and rights notifications. Use a closed vocabulary and sentence-pattern classifier rather than open-ended legal statements. For back-translation, drive a standardized avatar with reviewed motion clips instead of freely generating signs from arbitrary English. Low-confidence segments should directly prompt a retry, typing, or a human call. Store confirmation records separately from video, with records kept on the user’s device by default.

Punching above its weight

Recruit the first testers through Deaf organizations and community legal-aid centers, not broad consumer marketing. A solo builder can demonstrate a complete reporting flow on one tablet and ask KSL users to flag misunderstandings sentence by sentence. Publish the revised controlled phrase list for interpreter and legal-aid review. Show pilot results only as completion rates, reasons for human handoff, and deletion procedures, so public institutions can assess whether deployment is worthwhile.

Competitors & gaps

Signvrse Terp 360Google
Terp 360, offered by Nairobi-based Signvrse, provides real-time translation from speech or text into sign language through a 3D signing avatar. S4 Its website also describes two-way conversion between sign and spoken language. S4 That already covers the core capabilities of general translation and sign-language playback. Its public materials do not emphasize a justice-counter workflow or user confirmation before a statement is delivered. Nor do they connect low-confidence segments, human handoff, and bilingual summaries into an evidentiary trail. The opportunity is not another general-purpose translator, but a constrained legal-context product. Each playback should be tied to the user’s confirmation, and unconfirmed content must not enter the summary. Reporting, rights notifications, and document submission also require distinct templates.
Human sign-language interpreters with pen and paper or phone typingGoogle
Certified human interpreters remain the safer option for complex legal communication. They can ask about context, handle regional signing differences, and assess when legal terms need explanation. Pen and paper or phone typing are immediately available and require no trained model. Together, they are the currently acceptable alternatives at service counters. The limitation is that an interpreter may not be available for an unplanned visit, while writing pushes KSL users toward a written language they may not use fluently. Human-assisted exchanges also do not usually generate a bilingual, segment-by-segment confirmation summary. The product should preserve the authority of human interpreters and handle only short exchanges such as appointments and document submission. It should immediately hand off to a person for free-form statements or rights waivers. That improves response speed rather than replacing professional judgment.

How it makes money

Charge courts, police stations, and legal-aid providers a monthly fee per service-counter terminal. The fee covers device management, the controlled vocabulary, and summary exports. Remote human interpreters are billed separately by connected time.

The case against

Continuous KSL recognition must account for signing, body position, and facial grammar, and a small short-phrase dataset can easily miss regional and individual variation. If a legal negation, subject, or time reference is recognized incorrectly, users may confirm a translation they did not truly understand. The camera also captures faces and case details; a lost device, retained backend data, or misconfigured permissions could expose sensitive information. Counter lighting, framing, and network conditions add further failure points. If human handoff cannot connect quickly, the process may be slower than pen and paper. A bilingual summary must not be presented as formal testimony, or institutions assume risk for record authenticity and procedural fairness.

Evidence and sources

4 checkable sources cited
Trend observation· X
Real-time Kenyan Sign Language speech translation
Source metric
点赞 361 / 转发 134 / 浏览 10400发布后累计
Published
Snapshot time
snapshot July 27, 2026, 00:34 UTC
View the original page
Sources
S4

Signvrse’s website describes Terp 360 as a real-time sign-language translation platform that uses a 3D avatar to convert speech into sign language, and says its technology supports two-way translation between sign and spoken language.

Signvrsesignvrse.com
Telegram channel