datahub-transportation-gov/new-york-city-cv-pilot-event-data-one-month-sample-vxmm-9bi5
 
Readme
Updated 21 days ago
Indexed 2 hours ago

New York City CV Pilot EVENT Data One Month Sample

This dataset contains a one-month sample of flattened EVENT data records from the New York City (NYC) Connected Vehicle (CV) Pilot that have undergone obfuscation of precise time and location details as well as other vehicle identifiers. The full unflattened event data from NYC CV pilot can be found in the <a href="http://usdot-its-cvpilot-publicdata.s3.amazonaws.com/index.html" target="_blank" >ITS Sandbox</a>.

Each EVENT record documents the details of one application warning that occurred on an Aftermarket Safety Device (ASD) in an equipped host vehicle and includes CV messages from a defined recording time both before and after the warning was generated by the host ASD. Messages in the recording time window include the Basic Safety Messages (BSM) of the host vehicle that received the warning, as well as other BSMs received from the warning target equipped vehicle (for V2V applications) or other nearby equipped vehicles. Depending on the application warning type, MAP messages, Signal Phase and Timing (SPaT) messages, and Traveler Information Messages (TIM) that were heard by the host vehicle may also be included in the event record.

Columns

NameSocrata field nameColumn name in sgr mountData typeDescription
eventHeader_eventTypeeventheader_eventtypeeventheader_eventtypeTextThe CV application which triggered the warning. The value can be: "bsw" for Blind Spot Warning (V2V), "eebl" for Emergency Electronic Brake Lights (V2V), "fcw" for Forward Crash Warning (V2V), "ima" for Intersection Movement Assist (V2V), "lcw" for Lane Change Warning (V2V), "vtrw" for Vehicle Turning Right Warning (V2V), "cspdomp" for Curve speed compliance (V2I, "evacinfo" for Emergency Communications and Evacuation Information (V2I), "ovcclearancelimit" for Oversize Vehicle Compliance (V2I), "pedinxwalk" for Pedestrian in Signalized Crosswalk Warning (V2I), "rlvw" for Red Light Violation Warning (V2I), "spdcomp" for Speed Compliance (V2I), "spdcompwz" for Speed Compliance in Work Zone(V2I). See https://cvp.nyc/cv-safety-apps for details.
timListtimlisttimlistTextSequence of DF_TIMEvent dataframes in stringified array of json objects.
eventHeader_parameters_minSpdThresholdeventheader_parameters_4eventheader_parameters_4NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_speedConditioneventheader_speedconditioneventheader_speedconditionNumberInteger, miles per hour. Average speed (mph) of the roadway where the event occurred, as provided by non-CV pilot based speed monitoring systems available. Note that the average speed is reported for roadway segments which can be a mile or more in length; and may not truly represent the localized speeds on the roadway when the EVENT record was generated. When average roadway speed information is not available, this data element is omitted.
eventHeader_windSpeedeventheader_windspeedeventheader_windspeedNumberInteger, wind speed (knots)
eventHeader_triggerTVSeqNumeventheader_triggertvseqnumeventheader_triggertvseqnumTextSequence number of the target vehicle's BSM which triggered the warning that was issued. Refers to the MsgSeqNum in the list of BSM records contained in the EVENT record. Valid only for V2V applications.
eventHeader_triggerHVSeqNumeventheader_triggerhvseqnumeventheader_triggerhvseqnumTextSequence number of the host vehicle's BSM which triggered the warning that was issued. Refers to the MsgSeqNum in the list of BSM records contained in the EVENT record.
eventHeader_locationSourceeventheader_locationsourceeventheader_locationsourceTextProvides details on which method the location of the host vehicle was determined. Note this parameter is only meaningful in ASD firmware versions 4.3 or higher. Values can include: "gpsrsu": location is determined through a combination of GSP GNSS sensors, vehicle speed and yaw rate, and triangulation to nearby RSUs configured to broadcast V2XLocate details to ASDs. "gps": location is determined through a combination of GSP GNSS sensors, vehicle speed and yaw rate. "directgps": location is determined by GPS GNSS sensors only. Note in this location mode, BSM transmissions are halted as location is not know precisely enough for safety applications, and no event warnings should be issued.
eventHeader_eventTimeBineventheader_eventtimebineventheader_eventtimebinTextString in the format “YYYY-MM-DAY-TP" to provide some details of when the event took place, where: YYYY is the year (e.g. “2021”); MM is the month in number format (e.g. “05”); DAY is the day of the week (e.g. “TUE”) in a 3-character abbreviation; TP is the time period of the day. Detailed description for DAY and TP can be found in the descriptions for columns dayOfWeekBin and timeOfDayBin.
eventHeader_parameters_stopBarToleranceeventheader_parameters_14eventheader_parameters_14NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_excessiveCurveSpdTimeeventheader_parameters_9eventheader_parameters_9NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_timeRecordFolloweventheader_parameters_2eventheader_parameters_2NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_timeRecordBeforeeventheader_parameters_1eventheader_parameters_1NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_precipitation1Hreventheader_precipitation1hreventheader_precipitation1hrTextString, inches of precipitation in last hour; "M" indicates data is not available
eventHeader_airTemperatureeventheader_airtemperatureeventheader_airtemperatureNumberAir temperature, in degrees Fahrenheit
eventHeader_grpIdeventheader_grpideventheader_grpidNumberInteger representing the group to which the vehicle is assigned. ID <= 19: Pilot test vehicles. Vehicles used by the pilot team for ASD testing purposes throughout the pilot. ID = 20: Control group vehicle. Vehicles assigned to the control group operate in 'silent' mode throughout the deployment. ASDs should not deliver warnings to the drivers, but will still record EVENTS when applications determine a warning condition exists. ID >= 21: Treatment group vehicle. Vehicles assigned to the treatment group will all operate in 'silent' mode for the before deployment data collection period. At the start of the after or live deployment, all treatment vehicles will transition to 'active' mode, and start to deliver application warning messages to the drivers.
eventHeader_targetVehIDeventheader_targetvehideventheader_targetvehidTextTemporary ID of the target vehicle at the time of the warning. Valid only for V2V applications.
roadTypeBinroadtypebinroadtypebinTextBin providing insights into the road type where the event occurred, extracted from the eventHeader_eventLocationBin field. The value can be "1wayAve" for One-way Avenue in Manhattan, "2wayAve" for two-way Avenue in Manhattan, "1waySt" for one-way Street in Manhattan, "2waySt" for two-way Street in Manhattan, "Fwy" for a freeway, parkway, or otherwise controlled access roadway, "Art" for an arterial roadway, or "Oth" for other, generally collector or local level roadways. This field is created for use within Socrata and is not present in the data sandbox.
eventHeader_eventLocationBineventheader_eventlocationbineventheader_eventlocationbinTextString of the format “XX-YY-ZZZ”, to provide some details on where in NYC the event took place, where: XX indicates whether the roadway is near an road side unit (RSU), with "CV" if near and "NY" if not near; YY is a 2-character abbreviation of the NYC borough; ZZZ provides insights into the road type where the event occurred. Detailed description for YY and ZZZ can be found in the descriptions for columns bureauBin and roadTypeBin. Note when the event occurred outside of the NYC city limits, the code "nonNYC" is used as the entire entry for the eventLocationBin.
eventHeader_parameters_timeToCrasheventheader_parameters_5eventheader_parameters_5NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_excessiveSpdeventheader_parameters_7eventheader_parameters_7NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_eventAlertActiveeventheader_eventalertactiveeventheader_eventalertactiveCheckboxBoolean value indicating whether the ASD delivered the warning to the driver. True if the audible alert was issued, False if the alert was not issued (if ASD is configured for pre-deployment conditions or if the vehicle is part of the control group which does not received warnings).
nearRSUnearrsunearrsuCheckboxBoolean value indicating whether the roadway is near an RSU., extracted from the eventHeader_eventLocationBin field. This field is created for use within Socrata and is not present in the data sandbox.
eventHeader_parameters_excessiveSpdTimeeventheader_parameters_8eventheader_parameters_8NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
timeOfDayBintimeofdaybintimeofdaybinTextTime period of the day, extracted from the eventHeader_eventTimeBin field. The value can be "NT" for night (12-6am), "AM" for morning (6-10am), "MD" for midday (10am-3pm), "PM" for afternoon (3-8pm), "EV" for evening (8pm-12am), and "N/A" for unspecified time of day. This field is created for use within Socrata and is not present in the data sandbox.
eventHeader_hostVehIDeventheader_hostvehideventheader_hostvehidTextTemporary ID of the host vehicle at the time of the warning.
eventHeader_parameters_recordingROIeventheader_parameterseventheader_parametersNumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_minCurveSpdeventheader_parameters_12eventheader_parameters_12NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_excessiveZoneSpdeventheader_parameters_10eventheader_parameters_10NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_asdFirmwareVersioneventheader_asdfirmwareversioneventheader_asdfirmwareversionTextThe firmware running on the ASD at the time of the recorded event.
eventHeader_parameters_excessiveCurveSpdeventheader_parameters_6eventheader_parameters_6NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_timeRecordResolutioneventheader_parameters_3eventheader_parameters_3TextThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_eventStatuseventheader_eventstatuseventheader_eventstatusTextValue is always “Obfuscated” for released EVENT records
eventHeader_parameters_postedZoneSpeedeventheader_parameters_20eventheader_parameters_20NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_weatherConditioneventheader_weatherconditioneventheader_weatherconditionTextString describing of the weather conditions (from NWS)
eventHeader_eventAlertHeardeventheader_eventalertheardeventheader_eventalertheardCheckboxBoolean value indicating whether the ASD detected that the alert was heard or detected.
bureauBinbureaubinbureaubinTextA 2-character abbreviation of the NYC borough, extracted from the eventHeader_eventLocationBin field. The value can be "BK" for Brooklyn, "BX" for The Bronx, "MN" for Manhattan, "QN" for "Queens, and "SI" for Staten Island. This field is created for use within Socrata and is not present in the data sandbox.
dayOfWeekBindayofweekbindayofweekbinTextDay of the week (e.g. “TUE”) in a 3-character abbreviation, extracted from the eventHeader_eventTimeBin field. The value “N/A” may also appear as an additional level of obfuscation. This field is created for use within Socrata and is not present in the data sandbox.
eventHeader_eventAlertSenteventheader_eventalertsenteventheader_eventalertsentCheckboxBoolean value indicating whether the CV application determined if conditions warrant that a warning should be issued.
eventHeader_parameters_assumedDriverBrakingeventheader_parameters_17eventheader_parameters_17NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_excessiveZoneSpdTimeeventheader_parameters_11eventheader_parameters_11NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
mapListmaplistmaplistTextSequence of DF_MAPEvent dataframes in stringified array of json objects.
eventHeader_parameters_postedSizeLimiteventheader_parameters_19eventheader_parameters_19NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_regulatorySpeedeventheader_parameters_21eventheader_parameters_21NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
spatListspatlistspatlistTextSequence of DF_SPaTEvent dataframes in stringified array of json objects.
eventHeader_parameters_yellowDurationToleranceeventheader_parameters_15eventheader_parameters_15NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_minZoneSpdeventheader_parameters_13eventheader_parameters_13NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_parameters_postedHeightLimiteventheader_parameters_18eventheader_parameters_18NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
eventHeader_lastPlowedeventheader_lastplowedeventheader_lastplowedNumberInteger, minutes. Time (rounded to 5 minute values) since a snow plow last was seen on the roadway where the event occurred. Data included is as provided by the city's snow plow tracking and reporting system. A value of -1 indicates that snow plows were active in the city at the time of the event, but a snow plow has not yet travelled on the roadway where the event occurred. When the city's snow plow tracking and reporting system is not active, this data element is omitted.
eventHeader_parameters_hardBrakingThresholdeventheader_parameters_16eventheader_parameters_16NumberThis is part of the set of parameters that contains configuration parameters which help define how the ASD applications operate and how data is recorded. It is noted that which parameters are included vary based on the CV application warning type that the EVENT record is documenting.
bsmListbsmlistbsmlistTextSequence of DF_BSMEvent dataframes in stringified array of json objects.
Upstream Metadata