TrackOSC

TrackOSC

软件开发工具

创作者
Joel Lewis

TrackOSC可将iPhone变成无线运动跟踪相机,对准人物就能在本地网络以OSC消息形式传输身体姿势、手部姿势、面部特征点、识别文本及动物等实时跟踪数据,供多种软件使用。所有处理在设备上借助Apple的Vision框架完成,无视频流出,仅数据传输。具备实时跟踪叠加、探测器切换、前后摄像头可选、支持多种方向、网络接收器自动发现及隐藏视频模式等功能。

COMMUNITY PERKSMergeek 社区专属福利
独家限免 NEW每天发现一份惊喜
PRODUCT SCREENS / 1

点击查看界面细节

TrackOSC 产品截图 1

TrackOSC turns your iPhone into a wireless motion-tracking camera. Point it at a person and it streams live tracking data – body poses in 2D and 3D, hand poses, face landmarks, recognised text, animals, people, barcodes, outlines, the horizon and rectangles – over your local network as OSC (Open Sound Control) messages, ready for TouchDesigner, Max/MSP, Processing, openFrameworks, Pure Data, SuperCollider, Unity, or anything else that speaks OSC.

All processing happens on-device with Apple's Vision framework. No video ever leaves your phone – only numbers.

WHAT IT TRACKS
• 2D Body: a 17-joint skeleton in pixels
• 3D Body: a 17-joint skeleton in metres – real depth from a single camera, with each joint's pixel position alongside
• Hand: 21 joints per hand, up to two hands
• Face: the face box, head rotation and jawline contour, and Face Landmarks: the full 76-point constellation – eyes, pupils, brows, nose, lips, jaw
• Text: recognised text with its bounding box
• Animal: cat and dog boxes, and Animal Pose: full 25-joint cat and dog skeletons
• Human: whole-body boxes that keep counting people at distances where pose estimation gives up
• Barcode: QR codes and 1D/2D barcodes with position, corners, symbology and payload
• Contours: every edge outline in the frame as closed polylines
• Horizon: the horizon's angle and a line across the frame
• Rectangles: screens, paper, doors – a box plus four corners

FEATURES
• Live tracking overlays on the camera view, colour-coded per detector
• One chip per detector – run just what you need for the best frame rate; 3D Body runs in its own lane so it never slows the others
• Front or back camera, with a natural selfie mirror (wire data is never mirrored)
• Portrait and landscape, with an orientation lock for phones mounted on tripods and rigs
• Automatic discovery of receivers on your network via Bonjour – or type any IP and port
• Hide-video mode: tracking overlay only, on black – for stage and installation use
• Free, notari…

版本

1.6.0

Three new things to track, a clearer face, and a new chip for landmarks.

• Face Landmarks: a chip of its own next to Face. Face sends the box with head angles and the jawline; Face Landmarks sends the full 76-point constellation – eyes, pupils, brows, nose, lips, jaw – now drawn feature by feature on the overlay.
• Contours: every edge outline in the frame, simplified and streamed as closed polylines.
• Horizon: the angle of the horizon and a line across the frame.
• Rectangles: screens, sheets of paper, doors – box plus four corners in the rectangle's own orientation.
• Twelve detector chips, in a row that scrolls sideways.

The new data goes out as three additional OSC messages (/contours/arr, /horizon, /rectangles/arr); every earlier message is unchanged, so existing receivers keep working. The free macOS apps – Receiver, Recorder, Speaker and Router – gain a true full-screen mode with a chosen background colour, and a Senders setting so a recording played back is never mixed with a live phone.

Everything is still processed on the device; no video ever leaves your phone.

查看完整更新记录 ↗

你的真实体验,为其他用户提供宝贵参考,获得宝石奖励

REWARD MARKET100 宝石可兑换什么?

还没有公开评论,欢迎分享你的体验。

提交反馈

每一个想法,都让 Mergeek 更好一点。