Trojan Detection Software Challenge - Round 8 Test Dataset

This is the training data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform extractive question answering. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 360 QA AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.

Data e Risorse

Campo Valore
accessLevel public
bureauCode {006:55}
catalog_@context https://project-open-data.cio.gov/v1.1/schema/data.json
catalog_conformsTo https://project-open-data.cio.gov/v1.1/schema
catalog_describedBy https://project-open-data.cio.gov/v1.1/schema/catalog.json
identifier ark:/88434/mds2-2536
issued 2022-01-26
landingPage https://data.nist.gov/od/id/mds2-2536
language {en}
license https://www.nist.gov/open/license
modified 2021-08-09 00:00:00
programCode {006:045}
publisher National Institute of Standards and Technology
resource-type Dataset
source_datajson_identifier true
source_hash 1e758da581db9fb5054166e7f42ed80f17cffd33
source_schema_version 1.1
theme {"Information Technology:Software research","Information Technology:Cybersecurity"}
Gruppi
  • AmeriGEOSS
  • National Provider
  • North America
Tag
  • adversarial-machine-learning
  • ai
  • amerigeo
  • amerigeoss
  • artificial-intelligence
  • ckan
  • geo
  • geoss
  • machine-learning
  • national
  • north-america
  • trojan-detection
  • united-states
isopen False
license_id other-license-specified
license_title other-license-specified
maintainer Michael Paul Majurski
maintainer_email michael.majurski@nist.gov
metadata_created 2025-11-22T21:33:00.253410
metadata_modified 2025-11-22T21:33:00.253414
notes This is the training data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform extractive question answering. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 360 QA AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.
num_resources 83
num_tags 13
title Trojan Detection Software Challenge - Round 8 Test Dataset