2022-08-26 ADAPT Serialization Meetup

 

Participants

@Kelly Nelson Jim Wisner, @Jeremy W Wilson @Stuart Rhea (Deactivated) @Andres Ferreyra @Chris Ruttencutter @Charlie Guo (Unlicensed) @Corey Lacey @Bryce Hemme @Jim Wilson @Michael Figura @Zac Oler

Meeting Logistics

ADAPT Serialization Meet Up - 26 Aug - 1pm Chicago (2pm New York)

Fri, Aug 26, 2022 1:00 PM - 3:00 PM (CDT)

 

Please join my meeting from your computer, tablet or smartphone.
https://meet.goto.com/330169053

You can also dial in using your phone.
United States: +1 (646) 749-3129

Access Code: 330-169-053

More phone numbers:
Australia: +61 2 8355 1050
Austria: +43 1 2060 92967
Belgium: +32 28 93 7018
Brazil: +55 11 4118-4897
Bulgaria: +359 2 906 0605
Canada: +1 (647) 497-9391
Chile: +56 2 3214 9680
Colombia: +57 1 600 9953
Czech Republic: +420 2 55 71 95 02
Denmark: +45 32 72 03 82
Finland: +358 923 17 0568
France: +33 170 950 594
Germany: +49 721 9881 4161
Greece: +30 21 0 300 2583
Hungary: +36 1 933 3699
Ireland: +353 16 572 651
Israel: +972 3 376 3070
Italy: +39 0 230 57 81 42
Luxembourg: +352 34 2080 9219
Malaysia: +60 3 7724 4059
Mexico: +52 55 1500 3597
Netherlands: +31 207 941 377
New Zealand: +64 9 280 6302
Norway: +47 21 93 37 51
Panama: +507 308 4334
Peru: +51 1 642 9424
Romania: +40 31 780 1158
South Africa: +27 11 259 4924
Spain: +34 932 75 2004
Sweden: +46 853 527 836
Switzerland: +41 435 5015 61
Turkey: +90 212 900 4807
United Kingdom: +44 330 221 0088

 

Agenda and Minutes

Antitrust Reminder

  1. Leader: Chair

    1. In all of AgGateway's operations and activities, it must avoid discussions or conduct that might violate applicable antitrust laws, or even appear to do so. To that end, AgGateway has established Antitrust Guidelines, which it has provided to each participant in this meeting. While it is your ultimate responsibility to ensure that your actions comply with applicable antitrust laws, your participation in this meeting is affirmation that you will abide by AgGateway's guidelines.

    2. Antitrust Guidelines

  1. Minutes taker

    1. Leader:

    2. The desired outcome is that a minutes taker is selected.

    3. Minutes: @Ben Craker will take notes

  2. Agenda

    1. Leader: Chair

    2. The desired outcome is that the meeting participants agree to the agenda, adjusting first as required.

    3. Minutes: Agreed

Main Topics

Use decide tag for any decisions taken

  1. Main goals for serialization of ADAPT

    1. Topic Leader:

    2. The desired outcome is that we have agreement on the purpose, scope and overall goals for serializing ADAPT.

    3. Pre-meeting notes and references:

      1. Is the serialization effort specific to the standard version of ADAPT begin done in SCORE or would it apply to existing .net toolkit as well?

    4. Minutes

      1. Still too much room for interpretation within ADAPT. Still requires a lot of one off interpretation per OEM.

        1. Kelly’s three principles seems general agreement to these principles

          1. Should be open format and semantics, if it cant be translated keep it out. Everything in ADAPT should be open and readable by anyone authorized to have the data

          2. Data has to be flexible. Cannot mandate what must be serialized, ie spatial data can be a point or polygon

          3. Should be as human readable as possible. Balance file size, some form of zipped GeoJSON maybe. If we go to Protobuff or some binary path we should consider developing some tools for industry to use to make data more accessible/human readable

            1. Is possible to have both GeoJSON and Protobuff combination - yes

            2. ADAPT standard effort will deliver a schema (JSON)

            3. Maybe enhance SCORE to deliver a Proto schema as well as JSON?

            4. Tool exists to convert JSON to Proto already that could facilitate this

            5. Human readable = drop into QGis easily to trouble shoot issues in the data

            6. QGis plugin may be difficult to manage due to open source license QGis is under

        2. What are we serializing?

          1. All of ADAPT?

          2. Requiring standard names? DDI’s, other things that may not be in an “approved” industry vocabulary list

            1. We need to STRONGLY encourage folks to use WG00-mediated controlled vocabularies, BUT give them an option to use proprietary ones.

            2. Need to do a better job of making sure people know when Agrisemantics Subcommittee meets

  2. Key deliverables for Serialization project

    1. Topic Leader:

    2. The desired outcome is that the main deliverables required for serialization of ADAPT are identified and agreed to in order to scope a project/charter a working group

    3. Pre-meeting notes and references:

      1. Can serialize subsets of model “it is chunk-able”

      2. File sizes are reasonable

    4. Minutes:

      1. Main use cases

        1. Organizations to store data internally (persistent data storage) Not in scope

        2. Sharing data sets between systems

          1. Trend in industry seems to be OEM’s store data and share somewhat “processed” data

            1. ie three combines in a field, but share yield map without any DDOP, or machine identifiers, all data merged

            2. Is that ok, do we need the “original” data generated by each machine and the implement geometry etc. that comes with it

            3. Some concerns over being able to fix/understand data that has been lumped/processed together

        3. One file, side car files ok?

          1. ie Summary vs logged data in ADAPT

        4. Strictly time-series logged data

        5. Spacial representations

        6. I need to transfer data to someone else efficiently and they need to be able to understand it Primary Use Case

      2. Technical solution

        1. Proto buff, …

        2. Ideally will be determined by requirements, ie human readability

          1. Conduct some experiments to make informed decision on file size, human readability

        3. Corteva/Granular open sourced Geostream, a compressed geojson format https://github.com/granular-oss/geostream

  3. Proceed as an AgGateway working group

    1. Topic Leader: @Ben Craker

    2. The desired outcome is that the group agrees to how the serialization effort will be managed

    3. Pre-meeting notes and references:

      1. Preference is to run as a normal AgGateway working group, this provides the clear charter, tools, and process for creating a digital resource

      2. Also would be under AgGateway’s antitrust and IP policies making it clear how any contributions (code, or general knowledge) would be handled

      3. Can still utilize GitHub repo or confluence pages or other tools, whatever makes sense to achieve the deliverables laid out in topic 2.

      4. Only limitation is would be limited to AgGateway members

    4. Minutes:

      1. To build off what ADAPT currently is as an open source project, it may hinder participation/adoption if working group is limited to AgGateway members

      2. Working group could produce serialization and contribute to/as open source project

      3. Question if Europe is aware since most have been off the last ~month to voice opinion either way

  4. Project Leadership

    1. Topic Leader: @Ben Craker

    2. The desired outcome is that the group agrees to who will be the chair/vice chair of the working group

    3. Pre-meeting notes and references:

    4. Minutes:

      1. Chair: @Bryce Hemme

      2. Vice-Chair: @Stuart Rhea (Deactivated)

  5. Meeting time and cadence

    1. Topic Leader:

    2. The desired outcome is that the group agrees on the time, dates, duration, and location for subsequent meetings assuming there is consensus to move forward with the project

    3. Pre-meeting notes and references:

      1. Meet weekly, bi weekly, for an hour, two hours, schedule a couple day face-to-face?

    4. Minutes:

      1. Meet virtually to get started, in-person during/around annual conf.

        1. 9-12 Monday 14 Nov Clear Water Beach, FL AgGateway Annual Conf.

        2. Tuesdays at 1:30 central for one hour starting Sept 6

Closing Topics

Matters arising

  • Minutes:

Tasks assigned during meeting

  • Minutes:

Meeting schedule

  • Minutes: Next meeting on Sep 6, 2022 1:30 central Time

Adjournment

  • Minutes: Meeting adjourned at 2:49pm Central time