Systems note · September 2026
Hardware test pending
How the Tahoe CarPlay AI layer works
The Raspberry Pi owns the dashboard experience. CarPlay becomes one controllable pane inside it—not the boundary around the assistant.
The architectural move
Put the assistant in the signal path
A supported Carlinkit dongle pairs with the iPhone, but plugs into the
Pi rather than directly into the truck. node-CarPlay gives
the Pi the projected video and audio streams, plus commands for touch,
Siri, and microphone selection. The Pi can add its own assistant UI
before presenting the experience to the Tahoe display.
The Pi also hosts
- AI agent
- Wake word + mic
- Connectivity
- OBD-II
- Camera
Control plane
Three ways the agent operates CarPlay
Ask Siri
The Pi sends CarPlay's Siri command, then supplies the request through the microphone stream. This is the strongest route because it uses actions Siri already supports.
Send touch
The agent reads the projected frame and emits normalized touch coordinates. It can operate visible controls, but app redesigns can move targets and break the interaction.
Trigger the phone
A Shortcut or URL scheme performs the action on the iPhone while CarPlay displays the result. This avoids brittle screen tapping where an automation hook exists.
Two operating states
What changes without the phone
Phone connected
CarPlay + the Pi assistant
- Phone navigation, calls, messages, and media
- Siri and all three control routes
- Pi conversation, briefings, telemetry, and camera features
Phone absent
The Pi assistant remains
- Wake word, conversation, and briefings
- Independent connectivity, media, OBD-II, and camera
- No CarPlay pane, Siri, calls, messages, or phone maps
Hard boundary
What this does not control
The agent controls the projected phone session. It does not reach the Tahoe's climate, locks, drive modes, or native GM menus; those live on vehicle systems the CarPlay dongle never touches.
Build gate
Two unknowns decide whether it is viable
Microphone contention
An always-listening wake word may hold the audio channel in a degraded mode. The proposed mitigation is to listen on the dongle's mic and acquire the car mic only for an utterance.
Pi 4 display latency
The Pi must decode the projected frame, composite the assistant UI, and return a responsive display. That end-to-end loop has not been measured on the target hardware.