Coverage and interoperability of ASAM standards in an endpoint-2-edge-2-cloud application
The new ASAM Guide is essential reading for anyone involved in vehicle development. Many thanks to Dr. Ralf Nörenberg and Dr. Frank Hantschel for the exciting article (pp. 56-57) on the integration of ASAM standards in the RepliCar project!
The ASAM:GUIDE is a comprehensive reference to ASAM standards, ASAM technologies, ASAM members, and ASAM-compliant products. This guide is designed to be your go-to resource for understanding how ASAM supports the future of vehicle development and testing.
The guide provides an overview of ASAM’s complete standards portfolio and shares insights into how these standards interconnect and complement each other. The numerous application stories provided by our members give you a great impression of what can be achieved if you adopt standards and if you actively engage in their development. [by ASAM e.V.]
Safe perception of the environment and accurate localization of the ego perspective within the environment are two crucial prerequisites for the virtual validation of automated driving vehicles. The BMWK-funded joint project RepliCar (reference sensor technology for high-precision sensor validation for automated driving) is recording a highly accurate representation of reality as a comparative value for the validation.
RepliCar aims to integrate sensory ground truth data directly into the simulative validation. This includes data acquisition, data post-processing, feature extraction, and data fusion through to the object list. The project will rely on proven ASAM standards for data artifacts and interfaces and investigate their interoperability within an end-to-end toolchain for homologation. A GAIA-X-related data space enables partners to trustfully exchange information while keeping their intellectual property.
Replicar is a research project to improve processes of virtual validation of vehicles based on real world data. Explicitly, creating a new level of high-resolution ground truth supports investigating how test procedures must be adapted to validate the sensors‘ reliability. This is a necessity for homologation and avoidance of perception and display errors in the sensors.
#ASAM #ASAM_GUIDE #standardization #collaboration #automotive #mobility #standards #HighQSoft #RAConsulting #RepliCar
ASAM e.V. published a new version of the ASAM MDF standard - an ideal container file as input for ASAM ODS-based Test Data Management systems. ASAM MDF is a binary measurement file format that was first released in 1991. The two major versions in use are Version 3.x (2002-2009) and Version 4.x (2009-). The standard is backwards and forwards compatible (within a major version).
The following sections provide an overview of major MDF 4.3 features.
MDF is usually used to store data records of fixed size. For a sorted file (only one channel group per data group), this means one can jump to any desired record when reading. There is also support for storing signals of varying size e.g. strings. Each string may have a different length, so the variable length data is stored separately (e.g. in an SDBLOCK) and referenced from the channel block. Here, the fixed record stores an offset used to locate the string in the SDBLOCK.
MDF also supports arrays of fixed size (including multidimensional arrays) where each element is the same type of data. These strategies cannot handle more complex cases, where the number (or type) of signals changes with each record. This is dynamic data.
There are two main motivations for recording dynamic data:
MDF 4.3 introduces the DSBLOCK that can be used to mark a channel as containing dynamic data. In both cases, the raw data itself can be stored using the existing mechanisms for variable length data (VLSD, MLSD), fixed data or the new VLSC format.
The point of the DSBLOCK is to prevent readers supporting older versions of MDF from accessing and misinterpreting the dynamic data content, while referencing the description for MDF 4.3 compatible readers.
Features in Autonomous Driving or ADAS (advanced driver assistance system) are dependent on measurements of the environment made by sensors. A single item recorded by a sensor (e.g. a snapshot at a moment in time) is usually called a frame.
MDF extends the concept of a ‘frame’ to a sensor event: both the raw frame data and additional properties needed for interpretation (e.g. image dimensions).
MDF 4.x:
MDF 4.3
GNSS (Global Navigation Satellite System) is the generalisation of GPS. Previous versions of MDF didn’t provide a way to unambiguously recognize channels containing GNSS data. This made it difficult for readers to correctly interpret GNSS data (e.g. routes with latitude and longitude) in files written by third-party tools.
The new associated standard (Data Logging of Service Oriented Communication) is specifically designed to specify how SOME/IP is stored in MDF.
SOME/IP is a format for control messages sent over ethernet, used in AUTOSAR. It focuses on allowing clients to discover and subscribe to ‘services’ provided by a server. For example, this can be used to allow displays and telematics units to access data from cameras and other devices.
The standard defines names, tags and channel structures to allow a data logger to be able to store the raw content of the SOC data, with the important parts of the message structure ‘annotated’ in the form of MDF channels and metadata.
Most of the new dynamic data features can be stored in MDF using the existing mechanism for variable length signal data (VLSD) or maximum length signal data (MLSD).
However, VLSD has the disadvantage that the length of the variable signal data is always with the data itself, even after the file is sorted for efficient reading. This is often redundant when storing protocol data, since protocols often include the ‚count‘ as an additional channel.
VLSC allows the variable channel to reference a separate MDF channel that determines the count.
The changes are anticipated in the ASAM ODS 6.3 release which is scheduled for 2026.
#ASAMMDF #TDM #TestDataManagement #ASAMODS #HighQSoft
Today, we released a number of improvements for our products
The release includes several enhancements for managing catalogs in ASAM ODS (Physical Dimensions, Units, Quantities, and groups). The Catalog Editor provides comprehensive CRUD (Create, Read, Update, Delete) operations and additional features like transaction control, drag and drop functionality, and support for managing catalog elements and their instances.
This update allows creating transactions outside of HQL and requesting HQL to use them. This lifts the limitation of only one transaction per ASAM ODS session.
A new Validation Job Pipeline runs custom Python scripts on imported data if certain criteria are met. The scripts can generate new parameters or measurements based on the data.
Introduces a Job Pipeline for checking newly imported measurements against filter criteria stored in the ASAM ODS database. The pipeline stages include applying filter criteria, copying processing results, and triggering validation.
Implements a git storage for loading remote stage functions for Job Pipelines making it easier to manage and update scripts.
All updates enhance the functionality and flexibility of the Test Data Management Ecosystem providing robust tools for data validation, transaction handling, and catalog management.
#HighQSoft #Release #HQL #SoftwareUpdate #ASAMCommander #ASAMODS
Test Data Management can be a headache. Multiple proprietary formats, incompatible data structures, and a never-ending stream of new information can make it difficult, if not impossible, to turn raw data into actionable knowledge.
At HighQSoft, we specialize in wrangling your measurement data into something you can use today and in the future. We offer multiple products and solutions to help you organize and manage data, regardless of volume and format.
Our ASAMCommander is a test data management application based on the ASAM ODS standard (https://www.asam.net/standards/detail/ods/). As a modular web application, it comprises loosely coupled, functional units called modules that form a customizable experience for end-users, system and data administrators, or data analysts.
The basic version of ASAMCommander is an out-of-the-box application that provides all end-user use cases for data exploration (navigation, search, visualization), expert tool integration (e.g., AVL Concerto, Mathworks Matlab, NI DIAdem), and data exports (ASAM ATFx, CSV, ASAM MDF).
The Enterprise Edition of ASAMCommander is suited for Global Test Data Management solutions based on the AReS Libertas ODS6 Platform. System administration features include system logging, data lineage, and data retention. Our Merlin Analysis Framework provides all features for complete automation of analysis pipelines. ASAMCommander Enterprise allows customization, and new modules, features, and workflows are easy to add or integrate.
The ASAMCommander release 24.2 is now available at our download portal and includes:
AC-Mainframe
AC-Navigator
AC-Logger
General Features
The release contains various enhancements and updates for AC-MoMa, AC-Bookmarks, AC-Search, and AC-Merlin.
ASAMCommander works with any data model (ISO Safety, ASAM NVH, custom models), all domains (battery, powertrain, vehicle, ...), and any ASAM ODS server (AReS ODS Server, AVL Santorin).
#HighQSoft #TestDataManagement #MeasuredDataManagement #ASAMODS #ASAM #Release #Innovation
Libertas 24.1.3 brings a series of significant improvements and new features designed to enhance your experience. Here are the highlights of this release:
application/octet-stream content type, following industry recommendations for better compatibility.
These enhancements and fixes are part of our ongoing commitment to improving Libertas, making it more robust, secure, and user-friendly.
#HighQSoft #SoftwareUpdate #Libertas #Innovation
We are pleased to announce the release of ASAM Commander 24.1, packed with enhancements geared towards boosting stability and enhancing user experience across various modules, including some design upgrades throughout the entire application.
#HighQSoft #SoftwareUpdate #DataManagement #ASAMCommander #Innovation
Libertas 23.2.2 introduces several key fixes and improvements aimed at enhancing the performance and stability of the platform. Here's a summary of the notable changes:
#Libertas #LibertasRelease #SoftwareUpdate #HighQSoft
We're thrilled to announce the latest release of ASAMCommander, packed with numerous enhancements and improvements that promise to elevate your user experience to new heights. Our team has been hard at work in the AC 23.3 work package, focusing on stability, performance, adding new functionalities and refining overall design to ensure you get the most out of ASAMCommander.
These enhancements are geared towards making your experience seamless and efficient, empowering you to manage your data effectively.
Happy exploring!
#HighQSoft #SoftwareUpdate #DataManagement #ASAMCommander #Innovation
Today, we released a new version of our HighQSoft Query Language. This version provides the following features
Detailed release information can be found in our Confluence products space at https://highqsoft.atlassian.net/ which requires a log-in.
Today, we released a new version of our HighQSoft Query Language. This version provides the following features
Detailed release information can be found in our Confluence products space at https://highqsoft.atlassian.net/ which requires a log-in.
HighQSoft GmbH
Black-und-Decker-Straße 17b
D-65510 Idstein