Data Capturing and Recording

Logging and timestamping

Although numerous methods exist for logging and tapping in-vehicle network data, devices supporting the Capture Module Protocol (CMP) offer exceptional power and flexibility in our experience.

Analyzing in-vehicle network traffic is crucial for debugging, troubleshooting, and performance optimization in modern vehicles, which employ a wide range of communication technologies (CAN, CAN-FD, FlexRay, LIN, Automotive Ethernet BASE-T1, SerDes, Analog, etc.) between sensors, ECUs, and actuators. A robust solution for capturing and recording this data, especially Ethernet traffic, requires several key features: comprehensive data type support, precise time stamping and synchronization via 1588 or gPTP, and efficient data transfer over a standard Ethernet (BASE-TX) network to a PC or dedicated logger using Layer 2 Ethernet MAC frames.

Data Capturing & Recording

Understanding how vehicles collect and store in-vehicle network data and why it’s key for testing, validation, and safety

What Tapping, Data Capturing & Recording Means

Every vehicle today runs on data from sensors, cameras, ECUs, and communication systems. Data capture and tapping are essentially the same processes for collecting information from in‑vehicle networks (IVNs) in real time. Recording means securely saving it so engineers can study it later for testing, analysis, and development.

Think of it as the “black box” of your development process, more intelligent, faster, and designed for connected and autonomous systems.

Why It’s Important

Accurate data capture and recording help engineers understand what’s happening inside a vehicle at every moment. Whether it’s testing a new ADAS feature or diagnosing communication issues, clean and complete data saves time and prevents costly errors.

ADAS & Autonomous Development

Syncs video, radar, LiDAR, and ECU data for precise sensor fusion

Fleet Operations

Helps compare performance across multiple vehicles with consistent logging

R&D Labs

Enables controlled testing and faster validation of new network setups

Harsh Environments

Provides reliable recording even in trucks working near mining sites or rough conditions

Benefits of Logging Sensor Data in ADAS & AD Development

Ground Truth Creation & Validation

  • Sensor logs (camera, radar, lidar, GNSS, etc.) are used to create a "ground truth" reference

  • This enables validating perception algorithms by comparing real-world sensor inputs to expected outputs (e.g., object detection, lane recognition)

Reproducibility of Driving Scenarios

  • Logging allows exact replay of real-world situations (e.g., critical edge cases)

  • Enables developers and testers to recreate and analyze the same scenario repeatedly in a simulation or HiL (Hardware-in-the-Loop) environment

  • Ensures bugs can be identified and fixed deterministically

Algorithm Development & Training

  • Recorded data forms the basis for training and testing AI/ML algorithms

  • Enables development of perception, fusion, and decision-making modules based on real-world sensor behavior

Edge Case Detection

  • Logging in diverse conditions (e.g., night, snow, city, highway) helps identify corner cases and system limitations

  • Critical for building robust and safe AD/ADAS systems that perform reliably in all conditions

Performance Benchmarking

  • Logging allows you to compare software versions or hardware configurations using the same input data

  • Helps benchmark the performance of the perception stack (e.g., accuracy, latency, false positives/negatives)

Safety & Compliance

  • Logged data is used for safety analysis, traceability, and documentation

  • Critical for ISO 26262, SOTIF, and other functional safety standards

  • Helps in compliance reporting and audits for homologation or insurance purposes

 Data-Driven Debugging

  • Real sensor data helps identify and resolve:

    - Sensor alignment/calibration issues
    - Signal integrity problems (e.g., timing mismatches, noise)
    - Software errors in fusion, tracking, or control logic

Simulation & HiL Integration

  • Logged data feeds re-simulation environments and HiL rigs to validate ECUs and perception stacks before vehicle integration

  • Supports software-in-the-loop and replay-based validation without needing repeated real-world test drives

Continuous Improvement Post-Deployment

  • In production fleets, logging enables over-the-air diagnostics, OTA validation, and fleet learning

  • Helps improve system behavior with real-world usage feedback ("shadow mode" analysis)

How the Process Works

Step 1: Capturing Data / TAP

The Capture Module / TAP performs data capture and encapsulation, timestamping, filtering, traffic shaping, and much more, ensuring accurate, lossless data acquisition across vehicle networks. The Capture Module (or TAP) is responsible for acquiring all In-Vehicle Network (IVN) signals (such as Ethernet, CAN, and LIN) and converting them into a clean, timestamped format. It guarantees accurate, lossless data acquisition across vehicle networks by performing functions like data capture, encapsulation, timestamping, filtering, and traffic shaping. The use of gPTP ensures all data remains in sync and that no messages are missed.

Data Capture & Encapsulation

Converts IVN data into Ethernet-based TECMP & CMP (Capture Module Protocol)frames including device ID, channel ID, and timestamp

Timestamping

Hardware timestamping ensures precise time alignment with synchronization correction

Interface Identification

Includes interface ID and data loss counter in TECMP and CMP frames

Cascading

Supports multiple interconnected modules for flexible logging networks

Time Synchronization

Compatible with IEEE 802.1AS and IEEE 1588‑2008 standards

Startup Buffer

Internal buffering prevents data loss during boot phase

Filtering

Advanced rule-based pre‑processing with multiple configurable actions

Traffic Shaping

Manages bandwidth and prevents packet loss under heavy load

Transparency Mode

Maintains link state consistency between ECUs

Traffic Injection

Enables controlled data injection from logging sinks to ECUs

Status Messages

Generates regular module and configuration status updates for diagnostics

Step 2: Recording Data

Modern data loggers like the b-plus BRICK and DATALynx series push the limits of in-vehicle recording, capturing, synchronizing, and processing massive data streams from cameras, sensors, and ECUs with precise timing and zero packet loss. Designed to be rugged, modular, and scalable, they reliably handle high-speed data across all sensor domains.

Massive Multi‑Sensor Recording

Records high‑res camera, radar, LiDAR, and Ethernet traffic simultaneously without loss

Universal Connectivity

Interfaces with all ECUs and sensor types seamlessly

Extreme Throughput

Handles terabytes of data at 10 GbE speeds

Ultra‑Precise Time Sync

Sub‑microsecond accuracy using GPS, IEEE 802.1AS, or XTSS

Extreme Throughput

Handles terabytes of data at 10 GbE speeds

Ultra‑Precise Time Sync

Sub‑microsecond accuracy using GPS, IEEE 802.1AS, or XTSS

Modular Scalability

Expand storage, add GPU units, or integrate new sensor ports easily

Rugged Reliability

Operates flawlessly across harsh temperatures and vibration conditions

Flexible Storage

Hot‑swappable SSD modules simplify data management in the field

Intelligent Software Integration

Enables real‑time setup, monitoring, and quick data visualization

These advanced loggers ensure complete, synchronized, and high‑integrity data for development in ADAS, autonomy, and beyond.

Step 3: Analyzing & Using the Data

After recording, engineers can visualize and analyze the data, identifying timing issues, performance gaps, and unexpected behavior. This helps speed up debugging, validation, and overall system improvements.

After recording, engineers can visualize and analyze the data, identifying timing issues, performance gaps, and unexpected behavior. This helps speed up debugging, validation, and overall system improvements.

This makes the analysis phase faster, more precise, and more reliable, especially when dealing with complex in-vehicle networks.

How Techteal Engineering Supports You

Techteal helps bring all these steps together. Our solutions make sure your data capture and logging are reliable, synchronized, and easy to manage. We combine high‑performance hardware with simple, user‑friendly tools that give you precise results without extra complexity:

Learn more

In this video, explore the Technica Capture Module, a leading solution for capturing in-vehicle data with precision and reliability. Learn how it:

- Captures data across various bus systems with time-aware injection
- Provides seamless data logging using Ethernet-based formats like ASAM CMP
- Offers an intuitive, web-based interface for easy configuration.Watch now to see how this device can streamline your data logging and ensure you never miss critical information from in-vehicle systems.

We continuously add stories to our Insights page that show how logging is used in R&D labs, fleet vehicles, and heavy‑duty trucks near mining areas. These examples will show the real‑world value of proper data capture.

Talk to Techteal Engineering to find the best way to capture and record data for your project.