{
  "schemaVersion": 1,
  "videoId": "7otm-JgMGbk",
  "videoUrl": "https://www.youtube.com/watch?v=7otm-JgMGbk",
  "title": "Don’t Trust the First Model: A Methodology for Adversarial AI Audits",
  "speakerCredit": "Christian Vari",
  "programmeTalkId": "christian-vari-adversarial-ai-audits",
  "language": "en",
  "captionType": "auto-generated",
  "humanAccuracyReviewed": false,
  "spokenAudioCompletenessVerified": false,
  "cueEndTimesAvailable": false,
  "source": {
    "provider": "YouTube",
    "method": "native browser transcript export",
    "sha256": "4c75d3f91c3ba7c842bc174543489f1688987480c08f1d0e4bfda9a7bbed6666",
    "exportedAt": "2026-11-16T07:34:44.485896+00:00"
  },
  "qualityCaveats": [
    "Names, organizations, technical terms, code and numbers may be misrecognized.",
    "Source wording and disfluencies are preserved; no editorial corrections were applied.",
    "Export contains whole-second cue starts only; cue ends and subsecond timing are unavailable.",
    "A full caption-track export does not establish that every spoken word is represented.",
    "Automatic YouTube captions; not human-verified against the audio."
  ],
  "timingValidation": {
    "first_cue_start_seconds": 1,
    "last_cue_start_seconds": 774,
    "video_duration_seconds": 777,
    "seconds_after_last_cue_start": 3,
    "cue_start_gaps_over_30_seconds": [],
    "boundary_check": "pass",
    "criterion": "first cue <=15 seconds; last cue start within 30 seconds of player duration, allowing 1-second precision",
    "meaning": "Timing plausibility only; silence/applause or source caption omissions require audio review."
  },
  "segments": [
    {
      "index": 0,
      "start_seconds": 1,
      "source_timestamp": "0:01",
      "end_seconds": null,
      "text": "How many security researchers do we have"
    },
    {
      "index": 1,
      "start_seconds": 3,
      "source_timestamp": "0:03",
      "end_seconds": null,
      "text": "in the room? Raise your hand, guys. Oh,"
    },
    {
      "index": 2,
      "start_seconds": 6,
      "source_timestamp": "0:06",
      "end_seconds": null,
      "text": "great. I see a lot of you. So, from a"
    },
    {
      "index": 3,
      "start_seconds": 8,
      "source_timestamp": "0:08",
      "end_seconds": null,
      "text": "security researcher to security"
    },
    {
      "index": 4,
      "start_seconds": 10,
      "source_timestamp": "0:10",
      "end_seconds": null,
      "text": "researcher,"
    },
    {
      "index": 5,
      "start_seconds": 12,
      "source_timestamp": "0:12",
      "end_seconds": null,
      "text": "please don't trust the first model. So,"
    },
    {
      "index": 6,
      "start_seconds": 16,
      "source_timestamp": "0:16",
      "end_seconds": null,
      "text": "you know,"
    },
    {
      "index": 7,
      "start_seconds": 17,
      "source_timestamp": "0:17",
      "end_seconds": null,
      "text": "LLM models always try to convince us"
    },
    {
      "index": 8,
      "start_seconds": 19,
      "source_timestamp": "0:19",
      "end_seconds": null,
      "text": "that they went through all the code"
    },
    {
      "index": 9,
      "start_seconds": 20,
      "source_timestamp": "0:20",
      "end_seconds": null,
      "text": "base, they checked everything, and that"
    },
    {
      "index": 10,
      "start_seconds": 23,
      "source_timestamp": "0:23",
      "end_seconds": null,
      "text": "those this is the list of all the"
    },
    {
      "index": 11,
      "start_seconds": 25,
      "source_timestamp": "0:25",
      "end_seconds": null,
      "text": "vulnerabilities that are in the code"
    },
    {
      "index": 12,
      "start_seconds": 27,
      "source_timestamp": "0:27",
      "end_seconds": null,
      "text": "base."
    },
    {
      "index": 13,
      "start_seconds": 28,
      "source_timestamp": "0:28",
      "end_seconds": null,
      "text": "But the biggest issue that we have here"
    },
    {
      "index": 14,
      "start_seconds": 31,
      "source_timestamp": "0:31",
      "end_seconds": null,
      "text": "is that they are overconfident. And at"
    },
    {
      "index": 15,
      "start_seconds": 34,
      "source_timestamp": "0:34",
      "end_seconds": null,
      "text": "Ox Security, we developed a methodology"
    },
    {
      "index": 16,
      "start_seconds": 37,
      "source_timestamp": "0:37",
      "end_seconds": null,
      "text": "for doing this adversarially. So, how to"
    },
    {
      "index": 17,
      "start_seconds": 39,
      "source_timestamp": "0:39",
      "end_seconds": null,
      "text": "have models challenge each other in"
    },
    {
      "index": 18,
      "start_seconds": 42,
      "source_timestamp": "0:42",
      "end_seconds": null,
      "text": "order to reach an agreement."
    },
    {
      "index": 19,
      "start_seconds": 46,
      "source_timestamp": "0:46",
      "end_seconds": null,
      "text": "My name is Christian Vari. I'm the the"
    },
    {
      "index": 20,
      "start_seconds": 48,
      "source_timestamp": "0:48",
      "end_seconds": null,
      "text": "head of audit operation at Ox Security."
    },
    {
      "index": 21,
      "start_seconds": 50,
      "source_timestamp": "0:50",
      "end_seconds": null,
      "text": "Ox Security is"
    },
    {
      "index": 22,
      "start_seconds": 52,
      "source_timestamp": "0:52",
      "end_seconds": null,
      "text": "spotting vulnerabilities since 2017. We"
    },
    {
      "index": 23,
      "start_seconds": 56,
      "source_timestamp": "0:56",
      "end_seconds": null,
      "text": "have worked on more than 600"
    },
    {
      "index": 24,
      "start_seconds": 58,
      "source_timestamp": "0:58",
      "end_seconds": null,
      "text": "engagements, and we have a pool of more"
    },
    {
      "index": 25,
      "start_seconds": 61,
      "source_timestamp": "1:01",
      "end_seconds": null,
      "text": "than 50 senior security researchers."
    },
    {
      "index": 26,
      "start_seconds": 66,
      "source_timestamp": "1:06",
      "end_seconds": null,
      "text": "So,"
    },
    {
      "index": 27,
      "start_seconds": 68,
      "source_timestamp": "1:08",
      "end_seconds": null,
      "text": "we usually ask a lot of things to LLMs,"
    },
    {
      "index": 28,
      "start_seconds": 70,
      "source_timestamp": "1:10",
      "end_seconds": null,
      "text": "and we got usually good replies. So, we"
    },
    {
      "index": 29,
      "start_seconds": 73,
      "source_timestamp": "1:13",
      "end_seconds": null,
      "text": "get a lot of info from them."
    },
    {
      "index": 30,
      "start_seconds": 75,
      "source_timestamp": "1:15",
      "end_seconds": null,
      "text": "But there is one thing that we usually"
    },
    {
      "index": 31,
      "start_seconds": 78,
      "source_timestamp": "1:18",
      "end_seconds": null,
      "text": "don't know. We don't have the real"
    },
    {
      "index": 32,
      "start_seconds": 80,
      "source_timestamp": "1:20",
      "end_seconds": null,
      "text": "coverage of what they've done, the real"
    },
    {
      "index": 33,
      "start_seconds": 82,
      "source_timestamp": "1:22",
      "end_seconds": null,
      "text": "part that they checked. So,"
    },
    {
      "index": 34,
      "start_seconds": 85,
      "source_timestamp": "1:25",
      "end_seconds": null,
      "text": "is true that probably they checked"
    },
    {
      "index": 35,
      "start_seconds": 88,
      "source_timestamp": "1:28",
      "end_seconds": null,
      "text": "mostly of the things, but we don't have"
    },
    {
      "index": 36,
      "start_seconds": 90,
      "source_timestamp": "1:30",
      "end_seconds": null,
      "text": "the observability for being sure about"
    },
    {
      "index": 37,
      "start_seconds": 92,
      "source_timestamp": "1:32",
      "end_seconds": null,
      "text": "that. So, what if some files has not"
    },
    {
      "index": 38,
      "start_seconds": 95,
      "source_timestamp": "1:35",
      "end_seconds": null,
      "text": "been read, if some parts were not been"
    },
    {
      "index": 39,
      "start_seconds": 99,
      "source_timestamp": "1:39",
      "end_seconds": null,
      "text": "examined? What if they just keep it an"
    },
    {
      "index": 40,
      "start_seconds": 101,
      "source_timestamp": "1:41",
      "end_seconds": null,
      "text": "entire file?"
    },
    {
      "index": 41,
      "start_seconds": 103,
      "source_timestamp": "1:43",
      "end_seconds": null,
      "text": "We're not just thinking about, you know,"
    },
    {
      "index": 42,
      "start_seconds": 105,
      "source_timestamp": "1:45",
      "end_seconds": null,
      "text": "smart contracts, but maybe we are"
    },
    {
      "index": 43,
      "start_seconds": 107,
      "source_timestamp": "1:47",
      "end_seconds": null,
      "text": "auditing a full node or, you know,"
    },
    {
      "index": 44,
      "start_seconds": 111,
      "source_timestamp": "1:51",
      "end_seconds": null,
      "text": "off-chain components that then move"
    },
    {
      "index": 45,
      "start_seconds": 113,
      "source_timestamp": "1:53",
      "end_seconds": null,
      "text": "nodes. So, we have big parts, large"
    },
    {
      "index": 46,
      "start_seconds": 116,
      "source_timestamp": "1:56",
      "end_seconds": null,
      "text": "amount of code. How can we"
    },
    {
      "index": 47,
      "start_seconds": 119,
      "source_timestamp": "1:59",
      "end_seconds": null,
      "text": "be sure about coverage that they have"
    },
    {
      "index": 48,
      "start_seconds": 121,
      "source_timestamp": "2:01",
      "end_seconds": null,
      "text": "have checked? And also another thing,"
    },
    {
      "index": 49,
      "start_seconds": 125,
      "source_timestamp": "2:05",
      "end_seconds": null,
      "text": "not just, you know, the the file and the"
    },
    {
      "index": 50,
      "start_seconds": 127,
      "source_timestamp": "2:07",
      "end_seconds": null,
      "text": "code base, but also the claims. So have"
    },
    {
      "index": 51,
      "start_seconds": 128,
      "source_timestamp": "2:08",
      "end_seconds": null,
      "text": "they challenged really all the potential"
    },
    {
      "index": 52,
      "start_seconds": 131,
      "source_timestamp": "2:11",
      "end_seconds": null,
      "text": "things that are in the code base?"
    },
    {
      "index": 53,
      "start_seconds": 133,
      "source_timestamp": "2:13",
      "end_seconds": null,
      "text": "Have they challenged the assumptions?"
    },
    {
      "index": 54,
      "start_seconds": 136,
      "source_timestamp": "2:16",
      "end_seconds": null,
      "text": "We usually just by, you know, running"
    },
    {
      "index": 55,
      "start_seconds": 139,
      "source_timestamp": "2:19",
      "end_seconds": null,
      "text": "LLM or a model or something like that,"
    },
    {
      "index": 56,
      "start_seconds": 142,
      "source_timestamp": "2:22",
      "end_seconds": null,
      "text": "we're usually not really aware of that."
    },
    {
      "index": 57,
      "start_seconds": 145,
      "source_timestamp": "2:25",
      "end_seconds": null,
      "text": "So we came up with, you know,"
    },
    {
      "index": 58,
      "start_seconds": 148,
      "source_timestamp": "2:28",
      "end_seconds": null,
      "text": "an harness, a workflow. We have"
    },
    {
      "index": 59,
      "start_seconds": 150,
      "source_timestamp": "2:30",
      "end_seconds": null,
      "text": "implemented it and its name is Hive, but"
    },
    {
      "index": 60,
      "start_seconds": 153,
      "source_timestamp": "2:33",
      "end_seconds": null,
      "text": "in this talk I will just"
    },
    {
      "index": 61,
      "start_seconds": 155,
      "source_timestamp": "2:35",
      "end_seconds": null,
      "text": "tell you the methodology. I mean, you"
    },
    {
      "index": 62,
      "start_seconds": 157,
      "source_timestamp": "2:37",
      "end_seconds": null,
      "text": "can apply the same methodology."
    },
    {
      "index": 63,
      "start_seconds": 159,
      "source_timestamp": "2:39",
      "end_seconds": null,
      "text": "We"
    },
    {
      "index": 64,
      "start_seconds": 161,
      "source_timestamp": "2:41",
      "end_seconds": null,
      "text": "define it this in five steps actually."
    },
    {
      "index": 65,
      "start_seconds": 164,
      "source_timestamp": "2:44",
      "end_seconds": null,
      "text": "So the first one is the scope. So"
    },
    {
      "index": 66,
      "start_seconds": 166,
      "source_timestamp": "2:46",
      "end_seconds": null,
      "text": "as a security researcher is what we"
    },
    {
      "index": 67,
      "start_seconds": 168,
      "source_timestamp": "2:48",
      "end_seconds": null,
      "text": "usually do. We prepare a scope, okay? So"
    },
    {
      "index": 68,
      "start_seconds": 171,
      "source_timestamp": "2:51",
      "end_seconds": null,
      "text": "we have the commit hash of the code base"
    },
    {
      "index": 69,
      "start_seconds": 174,
      "source_timestamp": "2:54",
      "end_seconds": null,
      "text": "that we will review. We have, you know,"
    },
    {
      "index": 70,
      "start_seconds": 176,
      "source_timestamp": "2:56",
      "end_seconds": null,
      "text": "the architecture, we have the"
    },
    {
      "index": 71,
      "start_seconds": 178,
      "source_timestamp": "2:58",
      "end_seconds": null,
      "text": "boundaries, you know, the the the"
    },
    {
      "index": 72,
      "start_seconds": 181,
      "source_timestamp": "3:01",
      "end_seconds": null,
      "text": "preconditions and all the"
    },
    {
      "index": 73,
      "start_seconds": 183,
      "source_timestamp": "3:03",
      "end_seconds": null,
      "text": "issues or, you know,"
    },
    {
      "index": 74,
      "start_seconds": 185,
      "source_timestamp": "3:05",
      "end_seconds": null,
      "text": "things that are already known to the"
    },
    {
      "index": 75,
      "start_seconds": 187,
      "source_timestamp": "3:07",
      "end_seconds": null,
      "text": "client. Then we have for each of this"
    },
    {
      "index": 76,
      "start_seconds": 190,
      "source_timestamp": "3:10",
      "end_seconds": null,
      "text": "block a gate. So for the scope we have"
    },
    {
      "index": 77,
      "start_seconds": 192,
      "source_timestamp": "3:12",
      "end_seconds": null,
      "text": "the gate that we know the scope. Then we"
    },
    {
      "index": 78,
      "start_seconds": 195,
      "source_timestamp": "3:15",
      "end_seconds": null,
      "text": "have discover and this part actually is"
    },
    {
      "index": 79,
      "start_seconds": 198,
      "source_timestamp": "3:18",
      "end_seconds": null,
      "text": "where we use a multiple amount of"
    },
    {
      "index": 80,
      "start_seconds": 200,
      "source_timestamp": "3:20",
      "end_seconds": null,
      "text": "models. Usually we"
    },
    {
      "index": 81,
      "start_seconds": 203,
      "source_timestamp": "3:23",
      "end_seconds": null,
      "text": "try to run all of them, so from"
    },
    {
      "index": 82,
      "start_seconds": 205,
      "source_timestamp": "3:25",
      "end_seconds": null,
      "text": "different providers and different type"
    },
    {
      "index": 83,
      "start_seconds": 207,
      "source_timestamp": "3:27",
      "end_seconds": null,
      "text": "of models in order to check the code"
    },
    {
      "index": 84,
      "start_seconds": 209,
      "source_timestamp": "3:29",
      "end_seconds": null,
      "text": "base and spot all the possible"
    },
    {
      "index": 85,
      "start_seconds": 211,
      "source_timestamp": "3:31",
      "end_seconds": null,
      "text": "vulnerabilities. The important thing for"
    },
    {
      "index": 86,
      "start_seconds": 213,
      "source_timestamp": "3:33",
      "end_seconds": null,
      "text": "this is that at the end of this part of"
    },
    {
      "index": 87,
      "start_seconds": 215,
      "source_timestamp": "3:35",
      "end_seconds": null,
      "text": "the process we have some very specified"
    },
    {
      "index": 88,
      "start_seconds": 220,
      "source_timestamp": "3:40",
      "end_seconds": null,
      "text": "candidate of vulnerabilities. Then we"
    },
    {
      "index": 89,
      "start_seconds": 223,
      "source_timestamp": "3:43",
      "end_seconds": null,
      "text": "next to the the gate open and we move to"
    },
    {
      "index": 90,
      "start_seconds": 226,
      "source_timestamp": "3:46",
      "end_seconds": null,
      "text": "the next step that is actually the the"
    },
    {
      "index": 91,
      "start_seconds": 228,
      "source_timestamp": "3:48",
      "end_seconds": null,
      "text": "duplication. And we"
    },
    {
      "index": 92,
      "start_seconds": 231,
      "source_timestamp": "3:51",
      "end_seconds": null,
      "text": "actually perform some some execution of"
    },
    {
      "index": 93,
      "start_seconds": 234,
      "source_timestamp": "3:54",
      "end_seconds": null,
      "text": "the models in order to get a single"
    },
    {
      "index": 94,
      "start_seconds": 238,
      "source_timestamp": "3:58",
      "end_seconds": null,
      "text": "a single candidate. Then we do the"
    },
    {
      "index": 95,
      "start_seconds": 240,
      "source_timestamp": "4:00",
      "end_seconds": null,
      "text": "validation. I'll explain you why that is"
    },
    {
      "index": 96,
      "start_seconds": 242,
      "source_timestamp": "4:02",
      "end_seconds": null,
      "text": "one of the most important thing and we"
    },
    {
      "index": 97,
      "start_seconds": 244,
      "source_timestamp": "4:04",
      "end_seconds": null,
      "text": "then move to the the human part because"
    },
    {
      "index": 98,
      "start_seconds": 247,
      "source_timestamp": "4:07",
      "end_seconds": null,
      "text": "we believe that at the end of the"
    },
    {
      "index": 99,
      "start_seconds": 248,
      "source_timestamp": "4:08",
      "end_seconds": null,
      "text": "process we still need"
    },
    {
      "index": 100,
      "start_seconds": 250,
      "source_timestamp": "4:10",
      "end_seconds": null,
      "text": "human reviewer and this is just, you"
    },
    {
      "index": 101,
      "start_seconds": 252,
      "source_timestamp": "4:12",
      "end_seconds": null,
      "text": "know, a suggestion, an a testable"
    },
    {
      "index": 102,
      "start_seconds": 254,
      "source_timestamp": "4:14",
      "end_seconds": null,
      "text": "hypothesis of what the vulnerability"
    },
    {
      "index": 103,
      "start_seconds": 256,
      "source_timestamp": "4:16",
      "end_seconds": null,
      "text": "will be."
    },
    {
      "index": 104,
      "start_seconds": 258,
      "source_timestamp": "4:18",
      "end_seconds": null,
      "text": "So that's what I was saying before. We"
    },
    {
      "index": 105,
      "start_seconds": 260,
      "source_timestamp": "4:20",
      "end_seconds": null,
      "text": "are creating the scope but our tool"
    },
    {
      "index": 106,
      "start_seconds": 263,
      "source_timestamp": "4:23",
      "end_seconds": null,
      "text": "should be able to ensure that we check"
    },
    {
      "index": 107,
      "start_seconds": 265,
      "source_timestamp": "4:25",
      "end_seconds": null,
      "text": "all the all the files, all the paths and"
    },
    {
      "index": 108,
      "start_seconds": 268,
      "source_timestamp": "4:28",
      "end_seconds": null,
      "text": "check all the potential precondition and"
    },
    {
      "index": 109,
      "start_seconds": 271,
      "source_timestamp": "4:31",
      "end_seconds": null,
      "text": "and and also"
    },
    {
      "index": 110,
      "start_seconds": 274,
      "source_timestamp": "4:34",
      "end_seconds": null,
      "text": "the external dependencies where"
    },
    {
      "index": 111,
      "start_seconds": 277,
      "source_timestamp": "4:37",
      "end_seconds": null,
      "text": "something is built on."
    },
    {
      "index": 112,
      "start_seconds": 279,
      "source_timestamp": "4:39",
      "end_seconds": null,
      "text": "So for example here in the"
    },
    {
      "index": 113,
      "start_seconds": 281,
      "source_timestamp": "4:41",
      "end_seconds": null,
      "text": "in in this in this matrix we are just"
    },
    {
      "index": 114,
      "start_seconds": 284,
      "source_timestamp": "4:44",
      "end_seconds": null,
      "text": "checking, you know, that all the models"
    },
    {
      "index": 115,
      "start_seconds": 286,
      "source_timestamp": "4:46",
      "end_seconds": null,
      "text": "checked all the file and this is"
    },
    {
      "index": 116,
      "start_seconds": 287,
      "source_timestamp": "4:47",
      "end_seconds": null,
      "text": "important because sometimes we have a"
    },
    {
      "index": 117,
      "start_seconds": 290,
      "source_timestamp": "4:50",
      "end_seconds": null,
      "text": "global coverage on all the models that"
    },
    {
      "index": 118,
      "start_seconds": 292,
      "source_timestamp": "4:52",
      "end_seconds": null,
      "text": "are working on that but we are not"
    },
    {
      "index": 119,
      "start_seconds": 294,
      "source_timestamp": "4:54",
      "end_seconds": null,
      "text": "ensuring that the each model have 100%"
    },
    {
      "index": 120,
      "start_seconds": 298,
      "source_timestamp": "4:58",
      "end_seconds": null,
      "text": "of the coverage."
    },
    {
      "index": 121,
      "start_seconds": 301,
      "source_timestamp": "5:01",
      "end_seconds": null,
      "text": "Oh."
    },
    {
      "index": 122,
      "start_seconds": 303,
      "source_timestamp": "5:03",
      "end_seconds": null,
      "text": "Another important thing is that models"
    },
    {
      "index": 123,
      "start_seconds": 305,
      "source_timestamp": "5:05",
      "end_seconds": null,
      "text": "should not be biased and this is really"
    },
    {
      "index": 124,
      "start_seconds": 308,
      "source_timestamp": "5:08",
      "end_seconds": null,
      "text": "line with what we usually do with our"
    },
    {
      "index": 125,
      "start_seconds": 310,
      "source_timestamp": "5:10",
      "end_seconds": null,
      "text": "human auditors. So at Ox Security we"
    },
    {
      "index": 126,
      "start_seconds": 313,
      "source_timestamp": "5:13",
      "end_seconds": null,
      "text": "have our blinded approach where each"
    },
    {
      "index": 127,
      "start_seconds": 315,
      "source_timestamp": "5:15",
      "end_seconds": null,
      "text": "auditor actually go through the code"
    },
    {
      "index": 128,
      "start_seconds": 316,
      "source_timestamp": "5:16",
      "end_seconds": null,
      "text": "base"
    },
    {
      "index": 129,
      "start_seconds": 318,
      "source_timestamp": "5:18",
      "end_seconds": null,
      "text": "independently, so without sharing"
    },
    {
      "index": 130,
      "start_seconds": 319,
      "source_timestamp": "5:19",
      "end_seconds": null,
      "text": "insight with the other auditors. And we"
    },
    {
      "index": 131,
      "start_seconds": 322,
      "source_timestamp": "5:22",
      "end_seconds": null,
      "text": "are trying to do the same thing applied"
    },
    {
      "index": 132,
      "start_seconds": 323,
      "source_timestamp": "5:23",
      "end_seconds": null,
      "text": "to models. So the models have a shared"
    },
    {
      "index": 133,
      "start_seconds": 325,
      "source_timestamp": "5:25",
      "end_seconds": null,
      "text": "input where they have, you know, the"
    },
    {
      "index": 134,
      "start_seconds": 327,
      "source_timestamp": "5:27",
      "end_seconds": null,
      "text": "code base, the revision, the"
    },
    {
      "index": 135,
      "start_seconds": 329,
      "source_timestamp": "5:29",
      "end_seconds": null,
      "text": "architecture, all this kind of stuff."
    },
    {
      "index": 136,
      "start_seconds": 331,
      "source_timestamp": "5:31",
      "end_seconds": null,
      "text": "And then also we keep separate all their"
    },
    {
      "index": 137,
      "start_seconds": 334,
      "source_timestamp": "5:34",
      "end_seconds": null,
      "text": "work. So the candidate findings, the the"
    },
    {
      "index": 138,
      "start_seconds": 337,
      "source_timestamp": "5:37",
      "end_seconds": null,
      "text": "path that the models went through in"
    },
    {
      "index": 139,
      "start_seconds": 339,
      "source_timestamp": "5:39",
      "end_seconds": null,
      "text": "order to find the the vulnerabilities."
    },
    {
      "index": 140,
      "start_seconds": 343,
      "source_timestamp": "5:43",
      "end_seconds": null,
      "text": "Then we start with the discovery that is"
    },
    {
      "index": 141,
      "start_seconds": 345,
      "source_timestamp": "5:45",
      "end_seconds": null,
      "text": "executed by multiple models and is"
    },
    {
      "index": 142,
      "start_seconds": 347,
      "source_timestamp": "5:47",
      "end_seconds": null,
      "text": "actually performing two step. So we have"
    },
    {
      "index": 143,
      "start_seconds": 349,
      "source_timestamp": "5:49",
      "end_seconds": null,
      "text": "a blind pass where actually the models"
    },
    {
      "index": 144,
      "start_seconds": 353,
      "source_timestamp": "5:53",
      "end_seconds": null,
      "text": "go through the"
    },
    {
      "index": 145,
      "start_seconds": 354,
      "source_timestamp": "5:54",
      "end_seconds": null,
      "text": "most known, you know, vulnerabilities"
    },
    {
      "index": 146,
      "start_seconds": 356,
      "source_timestamp": "5:56",
      "end_seconds": null,
      "text": "glasses like I don't know, overflow,"
    },
    {
      "index": 147,
      "start_seconds": 359,
      "source_timestamp": "5:59",
      "end_seconds": null,
      "text": "arithmetic, all this kind of stuff. And"
    },
    {
      "index": 148,
      "start_seconds": 361,
      "source_timestamp": "6:01",
      "end_seconds": null,
      "text": "then we have an informed pass. So in all"
    },
    {
      "index": 149,
      "start_seconds": 363,
      "source_timestamp": "6:03",
      "end_seconds": null,
      "text": "the the past engagement, we got a lot of"
    },
    {
      "index": 150,
      "start_seconds": 366,
      "source_timestamp": "6:06",
      "end_seconds": null,
      "text": "knowledge about"
    },
    {
      "index": 151,
      "start_seconds": 368,
      "source_timestamp": "6:08",
      "end_seconds": null,
      "text": "vulnerabilities and potential issues."
    },
    {
      "index": 152,
      "start_seconds": 371,
      "source_timestamp": "6:11",
      "end_seconds": null,
      "text": "So, we created a a dataset for that and"
    },
    {
      "index": 153,
      "start_seconds": 375,
      "source_timestamp": "6:15",
      "end_seconds": null,
      "text": "we used that in the informed pass. And"
    },
    {
      "index": 154,
      "start_seconds": 377,
      "source_timestamp": "6:17",
      "end_seconds": null,
      "text": "we actually execute both. The informed"
    },
    {
      "index": 155,
      "start_seconds": 379,
      "source_timestamp": "6:19",
      "end_seconds": null,
      "text": "pass is also very specific depending on"
    },
    {
      "index": 156,
      "start_seconds": 381,
      "source_timestamp": "6:21",
      "end_seconds": null,
      "text": "the on the technology that we are"
    },
    {
      "index": 157,
      "start_seconds": 384,
      "source_timestamp": "6:24",
      "end_seconds": null,
      "text": "auditing."
    },
    {
      "index": 158,
      "start_seconds": 386,
      "source_timestamp": "6:26",
      "end_seconds": null,
      "text": "Another important thing is that at the"
    },
    {
      "index": 159,
      "start_seconds": 388,
      "source_timestamp": "6:28",
      "end_seconds": null,
      "text": "end of the discovery phase, we have the"
    },
    {
      "index": 160,
      "start_seconds": 391,
      "source_timestamp": "6:31",
      "end_seconds": null,
      "text": "claim that is testable and that is well"
    },
    {
      "index": 161,
      "start_seconds": 394,
      "source_timestamp": "6:34",
      "end_seconds": null,
      "text": "defined. So, we have to know who is the"
    },
    {
      "index": 162,
      "start_seconds": 396,
      "source_timestamp": "6:36",
      "end_seconds": null,
      "text": "attacker, so their role and his"
    },
    {
      "index": 163,
      "start_seconds": 398,
      "source_timestamp": "6:38",
      "end_seconds": null,
      "text": "capabilities. What are the"
    },
    {
      "index": 164,
      "start_seconds": 399,
      "source_timestamp": "6:39",
      "end_seconds": null,
      "text": "preconditions? So, probably"
    },
    {
      "index": 165,
      "start_seconds": 402,
      "source_timestamp": "6:42",
      "end_seconds": null,
      "text": "you know"
    },
    {
      "index": 166,
      "start_seconds": 404,
      "source_timestamp": "6:44",
      "end_seconds": null,
      "text": "that type of attacker have a"
    },
    {
      "index": 167,
      "start_seconds": 405,
      "source_timestamp": "6:45",
      "end_seconds": null,
      "text": "precondition and depending on the"
    },
    {
      "index": 168,
      "start_seconds": 406,
      "source_timestamp": "6:46",
      "end_seconds": null,
      "text": "precondition depends also the severity."
    },
    {
      "index": 169,
      "start_seconds": 409,
      "source_timestamp": "6:49",
      "end_seconds": null,
      "text": "The boundary, the invariance, if there"
    },
    {
      "index": 170,
      "start_seconds": 412,
      "source_timestamp": "6:52",
      "end_seconds": null,
      "text": "are scoped invariance, actually it"
    },
    {
      "index": 171,
      "start_seconds": 414,
      "source_timestamp": "6:54",
      "end_seconds": null,
      "text": "should be checked. The location"
    },
    {
      "index": 172,
      "start_seconds": 416,
      "source_timestamp": "6:56",
      "end_seconds": null,
      "text": "obviously, so the code and the related"
    },
    {
      "index": 173,
      "start_seconds": 418,
      "source_timestamp": "6:58",
      "end_seconds": null,
      "text": "code and the provenance, so which model"
    },
    {
      "index": 174,
      "start_seconds": 421,
      "source_timestamp": "7:01",
      "end_seconds": null,
      "text": "found it and which phase. So, the"
    },
    {
      "index": 175,
      "start_seconds": 422,
      "source_timestamp": "7:02",
      "end_seconds": null,
      "text": "important thing for us is keeping"
    },
    {
      "index": 176,
      "start_seconds": 425,
      "source_timestamp": "7:05",
      "end_seconds": null,
      "text": "an audit log actually of what happened,"
    },
    {
      "index": 177,
      "start_seconds": 427,
      "source_timestamp": "7:07",
      "end_seconds": null,
      "text": "who found something and the path that"
    },
    {
      "index": 178,
      "start_seconds": 429,
      "source_timestamp": "7:09",
      "end_seconds": null,
      "text": "has been executed. This is very"
    },
    {
      "index": 179,
      "start_seconds": 431,
      "source_timestamp": "7:11",
      "end_seconds": null,
      "text": "important especially on very very large"
    },
    {
      "index": 180,
      "start_seconds": 432,
      "source_timestamp": "7:12",
      "end_seconds": null,
      "text": "code bases where we have, I don't know,"
    },
    {
      "index": 181,
      "start_seconds": 434,
      "source_timestamp": "7:14",
      "end_seconds": null,
      "text": "a node that is depending on a big SDK"
    },
    {
      "index": 182,
      "start_seconds": 438,
      "source_timestamp": "7:18",
      "end_seconds": null,
      "text": "and actually we have to scope the the"
    },
    {
      "index": 183,
      "start_seconds": 441,
      "source_timestamp": "7:21",
      "end_seconds": null,
      "text": "whole path in order to pass it correctly"
    },
    {
      "index": 184,
      "start_seconds": 444,
      "source_timestamp": "7:24",
      "end_seconds": null,
      "text": "to the model and also, you know,"
    },
    {
      "index": 185,
      "start_seconds": 446,
      "source_timestamp": "7:26",
      "end_seconds": null,
      "text": "have"
    },
    {
      "index": 186,
      "start_seconds": 447,
      "source_timestamp": "7:27",
      "end_seconds": null,
      "text": "a feasible type of cost because, you"
    },
    {
      "index": 187,
      "start_seconds": 450,
      "source_timestamp": "7:30",
      "end_seconds": null,
      "text": "know, tokens are not free."
    },
    {
      "index": 188,
      "start_seconds": 454,
      "source_timestamp": "7:34",
      "end_seconds": null,
      "text": "Another part that is important, so after"
    },
    {
      "index": 189,
      "start_seconds": 457,
      "source_timestamp": "7:37",
      "end_seconds": null,
      "text": "the the the discovery part, we have this"
    },
    {
      "index": 190,
      "start_seconds": 459,
      "source_timestamp": "7:39",
      "end_seconds": null,
      "text": "list of of findings, potential findings."
    },
    {
      "index": 191,
      "start_seconds": 463,
      "source_timestamp": "7:43",
      "end_seconds": null,
      "text": "We have to duplicate them. And, you"
    },
    {
      "index": 192,
      "start_seconds": 465,
      "source_timestamp": "7:45",
      "end_seconds": null,
      "text": "know,"
    },
    {
      "index": 193,
      "start_seconds": 466,
      "source_timestamp": "7:46",
      "end_seconds": null,
      "text": "as a security researcher, everyone has a"
    },
    {
      "index": 194,
      "start_seconds": 468,
      "source_timestamp": "7:48",
      "end_seconds": null,
      "text": "way for doing the duplication, okay?"
    },
    {
      "index": 195,
      "start_seconds": 472,
      "source_timestamp": "7:52",
      "end_seconds": null,
      "text": "It's a very opinionated thing. And in"
    },
    {
      "index": 196,
      "start_seconds": 474,
      "source_timestamp": "7:54",
      "end_seconds": null,
      "text": "our opinion, the best way is with the"
    },
    {
      "index": 197,
      "start_seconds": 476,
      "source_timestamp": "7:56",
      "end_seconds": null,
      "text": "root cause, okay? So, here for example,"
    },
    {
      "index": 198,
      "start_seconds": 478,
      "source_timestamp": "7:58",
      "end_seconds": null,
      "text": "we have two claims but they have the the"
    },
    {
      "index": 199,
      "start_seconds": 480,
      "source_timestamp": "8:00",
      "end_seconds": null,
      "text": "same root cause and the same fix fix the"
    },
    {
      "index": 200,
      "start_seconds": 482,
      "source_timestamp": "8:02",
      "end_seconds": null,
      "text": "same thing. And the model should be able"
    },
    {
      "index": 201,
      "start_seconds": 485,
      "source_timestamp": "8:05",
      "end_seconds": null,
      "text": "also to separate the things that that"
    },
    {
      "index": 202,
      "start_seconds": 488,
      "source_timestamp": "8:08",
      "end_seconds": null,
      "text": "makes each claim"
    },
    {
      "index": 203,
      "start_seconds": 490,
      "source_timestamp": "8:10",
      "end_seconds": null,
      "text": "unique. So, for example, here it should"
    },
    {
      "index": 204,
      "start_seconds": 492,
      "source_timestamp": "8:12",
      "end_seconds": null,
      "text": "be able to"
    },
    {
      "index": 205,
      "start_seconds": 494,
      "source_timestamp": "8:14",
      "end_seconds": null,
      "text": "separate the part that are in common and"
    },
    {
      "index": 206,
      "start_seconds": 496,
      "source_timestamp": "8:16",
      "end_seconds": null,
      "text": "merge them into just one and then also"
    },
    {
      "index": 207,
      "start_seconds": 499,
      "source_timestamp": "8:19",
      "end_seconds": null,
      "text": "create another findings with the"
    },
    {
      "index": 208,
      "start_seconds": 500,
      "source_timestamp": "8:20",
      "end_seconds": null,
      "text": "remaining part."
    },
    {
      "index": 209,
      "start_seconds": 504,
      "source_timestamp": "8:24",
      "end_seconds": null,
      "text": "It's not working."
    },
    {
      "index": 210,
      "start_seconds": 507,
      "source_timestamp": "8:27",
      "end_seconds": null,
      "text": "Okay. Well,"
    },
    {
      "index": 211,
      "start_seconds": 512,
      "source_timestamp": "8:32",
      "end_seconds": null,
      "text": "just trying."
    },
    {
      "index": 212,
      "start_seconds": 513,
      "source_timestamp": "8:33",
      "end_seconds": null,
      "text": "By the way, even if it's not moving."
    },
    {
      "index": 213,
      "start_seconds": 516,
      "source_timestamp": "8:36",
      "end_seconds": null,
      "text": "Okay. Yeah, after that we have the"
    },
    {
      "index": 214,
      "start_seconds": 518,
      "source_timestamp": "8:38",
      "end_seconds": null,
      "text": "validation. This is the most important"
    },
    {
      "index": 215,
      "start_seconds": 520,
      "source_timestamp": "8:40",
      "end_seconds": null,
      "text": "part because"
    },
    {
      "index": 216,
      "start_seconds": 522,
      "source_timestamp": "8:42",
      "end_seconds": null,
      "text": "actually we use this as hypothesis for"
    },
    {
      "index": 217,
      "start_seconds": 525,
      "source_timestamp": "8:45",
      "end_seconds": null,
      "text": "the security researcher and we don't"
    },
    {
      "index": 218,
      "start_seconds": 527,
      "source_timestamp": "8:47",
      "end_seconds": null,
      "text": "want to waste the time of security"
    },
    {
      "index": 219,
      "start_seconds": 529,
      "source_timestamp": "8:49",
      "end_seconds": null,
      "text": "researcher. So, it's true that we have a"
    },
    {
      "index": 220,
      "start_seconds": 530,
      "source_timestamp": "8:50",
      "end_seconds": null,
      "text": "lot of harnesses for generating"
    },
    {
      "index": 221,
      "start_seconds": 533,
      "source_timestamp": "8:53",
      "end_seconds": null,
      "text": "findings,"
    },
    {
      "index": 222,
      "start_seconds": 534,
      "source_timestamp": "8:54",
      "end_seconds": null,
      "text": "but there are a lot of false positive"
    },
    {
      "index": 223,
      "start_seconds": 536,
      "source_timestamp": "8:56",
      "end_seconds": null,
      "text": "and bringing a lot of false positive to"
    },
    {
      "index": 224,
      "start_seconds": 539,
      "source_timestamp": "8:59",
      "end_seconds": null,
      "text": "security researcher is actually a waste"
    },
    {
      "index": 225,
      "start_seconds": 540,
      "source_timestamp": "9:00",
      "end_seconds": null,
      "text": "of time. You know, you have 200"
    },
    {
      "index": 226,
      "start_seconds": 542,
      "source_timestamp": "9:02",
      "end_seconds": null,
      "text": "potential findings and the security"
    },
    {
      "index": 227,
      "start_seconds": 544,
      "source_timestamp": "9:04",
      "end_seconds": null,
      "text": "researcher have to spend their time on"
    },
    {
      "index": 228,
      "start_seconds": 546,
      "source_timestamp": "9:06",
      "end_seconds": null,
      "text": "double checking all these AI crap"
    },
    {
      "index": 229,
      "start_seconds": 549,
      "source_timestamp": "9:09",
      "end_seconds": null,
      "text": "instead of checking anti-code. And this"
    },
    {
      "index": 230,
      "start_seconds": 551,
      "source_timestamp": "9:11",
      "end_seconds": null,
      "text": "is, you know, is something that we"
    },
    {
      "index": 231,
      "start_seconds": 554,
      "source_timestamp": "9:14",
      "end_seconds": null,
      "text": "cannot deal with. So, the idea here is"
    },
    {
      "index": 232,
      "start_seconds": 555,
      "source_timestamp": "9:15",
      "end_seconds": null,
      "text": "to rerun all the the claims that have"
    },
    {
      "index": 233,
      "start_seconds": 559,
      "source_timestamp": "9:19",
      "end_seconds": null,
      "text": "been found adversarially through other"
    },
    {
      "index": 234,
      "start_seconds": 561,
      "source_timestamp": "9:21",
      "end_seconds": null,
      "text": "models. So,"
    },
    {
      "index": 235,
      "start_seconds": 563,
      "source_timestamp": "9:23",
      "end_seconds": null,
      "text": "we create a fresh context with this with"
    },
    {
      "index": 236,
      "start_seconds": 565,
      "source_timestamp": "9:25",
      "end_seconds": null,
      "text": "all the data that is required, all the"
    },
    {
      "index": 237,
      "start_seconds": 567,
      "source_timestamp": "9:27",
      "end_seconds": null,
      "text": "dependencies and all the the the the"
    },
    {
      "index": 238,
      "start_seconds": 570,
      "source_timestamp": "9:30",
      "end_seconds": null,
      "text": "architecture part that is needed and we"
    },
    {
      "index": 239,
      "start_seconds": 572,
      "source_timestamp": "9:32",
      "end_seconds": null,
      "text": "actually let those new models try to"
    },
    {
      "index": 240,
      "start_seconds": 575,
      "source_timestamp": "9:35",
      "end_seconds": null,
      "text": "execute them and validate it."
    },
    {
      "index": 241,
      "start_seconds": 579,
      "source_timestamp": "9:39",
      "end_seconds": null,
      "text": "Also, it's very important especially in"
    },
    {
      "index": 242,
      "start_seconds": 581,
      "source_timestamp": "9:41",
      "end_seconds": null,
      "text": "large code base like I don't know"
    },
    {
      "index": 243,
      "start_seconds": 583,
      "source_timestamp": "9:43",
      "end_seconds": null,
      "text": "blockchain node or this kind of stuff to"
    },
    {
      "index": 244,
      "start_seconds": 585,
      "source_timestamp": "9:45",
      "end_seconds": null,
      "text": "give all the the the path to them, so"
    },
    {
      "index": 245,
      "start_seconds": 588,
      "source_timestamp": "9:48",
      "end_seconds": null,
      "text": "the the the dependencies. So, imagine a"
    },
    {
      "index": 246,
      "start_seconds": 590,
      "source_timestamp": "9:50",
      "end_seconds": null,
      "text": "big SDK or this kind of stuff. So, we"
    },
    {
      "index": 247,
      "start_seconds": 593,
      "source_timestamp": "9:53",
      "end_seconds": null,
      "text": "have to give all the context needed"
    },
    {
      "index": 248,
      "start_seconds": 595,
      "source_timestamp": "9:55",
      "end_seconds": null,
      "text": "trying to scope it to make, you know,"
    },
    {
      "index": 249,
      "start_seconds": 597,
      "source_timestamp": "9:57",
      "end_seconds": null,
      "text": "the less amount to spend the less amount"
    },
    {
      "index": 250,
      "start_seconds": 599,
      "source_timestamp": "9:59",
      "end_seconds": null,
      "text": "of tokens and this will be able actually"
    },
    {
      "index": 251,
      "start_seconds": 603,
      "source_timestamp": "10:03",
      "end_seconds": null,
      "text": "our models to"
    },
    {
      "index": 252,
      "start_seconds": 606,
      "source_timestamp": "10:06",
      "end_seconds": null,
      "text": "identify where a path is actually"
    },
    {
      "index": 253,
      "start_seconds": 608,
      "source_timestamp": "10:08",
      "end_seconds": null,
      "text": "something that is reachable or not, for"
    },
    {
      "index": 254,
      "start_seconds": 610,
      "source_timestamp": "10:10",
      "end_seconds": null,
      "text": "example, because it's very common, you"
    },
    {
      "index": 255,
      "start_seconds": 612,
      "source_timestamp": "10:12",
      "end_seconds": null,
      "text": "know, with models when use them, that"
    },
    {
      "index": 256,
      "start_seconds": 613,
      "source_timestamp": "10:13",
      "end_seconds": null,
      "text": "say, okay, we have this kind of"
    },
    {
      "index": 257,
      "start_seconds": 615,
      "source_timestamp": "10:15",
      "end_seconds": null,
      "text": "vulnerabilities,"
    },
    {
      "index": 258,
      "start_seconds": 616,
      "source_timestamp": "10:16",
      "end_seconds": null,
      "text": "just go through it and you can execute"
    },
    {
      "index": 259,
      "start_seconds": 618,
      "source_timestamp": "10:18",
      "end_seconds": null,
      "text": "it. But then it's not really true"
    },
    {
      "index": 260,
      "start_seconds": 620,
      "source_timestamp": "10:20",
      "end_seconds": null,
      "text": "because it may be in a dependency of,"
    },
    {
      "index": 261,
      "start_seconds": 622,
      "source_timestamp": "10:22",
      "end_seconds": null,
      "text": "you know, depending on the on the"
    },
    {
      "index": 262,
      "start_seconds": 625,
      "source_timestamp": "10:25",
      "end_seconds": null,
      "text": "execution,"
    },
    {
      "index": 263,
      "start_seconds": 627,
      "source_timestamp": "10:27",
      "end_seconds": null,
      "text": "there is a difference because maybe it's"
    },
    {
      "index": 264,
      "start_seconds": 629,
      "source_timestamp": "10:29",
      "end_seconds": null,
      "text": "gated, so like in this example."
    },
    {
      "index": 265,
      "start_seconds": 632,
      "source_timestamp": "10:32",
      "end_seconds": null,
      "text": "And one another thing that is important"
    },
    {
      "index": 266,
      "start_seconds": 635,
      "source_timestamp": "10:35",
      "end_seconds": null,
      "text": "in our process is confidence. So I mean,"
    },
    {
      "index": 267,
      "start_seconds": 639,
      "source_timestamp": "10:39",
      "end_seconds": null,
      "text": "we"
    },
    {
      "index": 268,
      "start_seconds": 640,
      "source_timestamp": "10:40",
      "end_seconds": null,
      "text": "have traced all the the"
    },
    {
      "index": 269,
      "start_seconds": 643,
      "source_timestamp": "10:43",
      "end_seconds": null,
      "text": "all the path that our model our"
    },
    {
      "index": 270,
      "start_seconds": 646,
      "source_timestamp": "10:46",
      "end_seconds": null,
      "text": "methodology has going through, so we"
    },
    {
      "index": 271,
      "start_seconds": 648,
      "source_timestamp": "10:48",
      "end_seconds": null,
      "text": "know which model found something and at"
    },
    {
      "index": 272,
      "start_seconds": 650,
      "source_timestamp": "10:50",
      "end_seconds": null,
      "text": "which stage. And we have all the audit"
    },
    {
      "index": 273,
      "start_seconds": 652,
      "source_timestamp": "10:52",
      "end_seconds": null,
      "text": "log of this. Having this, we have this"
    },
    {
      "index": 274,
      "start_seconds": 655,
      "source_timestamp": "10:55",
      "end_seconds": null,
      "text": "part of the model that actually create a"
    },
    {
      "index": 275,
      "start_seconds": 657,
      "source_timestamp": "10:57",
      "end_seconds": null,
      "text": "summary of that"
    },
    {
      "index": 276,
      "start_seconds": 659,
      "source_timestamp": "10:59",
      "end_seconds": null,
      "text": "and also depending on a threshold, put"
    },
    {
      "index": 277,
      "start_seconds": 662,
      "source_timestamp": "11:02",
      "end_seconds": null,
      "text": "the findings in a different way. And the"
    },
    {
      "index": 278,
      "start_seconds": 665,
      "source_timestamp": "11:05",
      "end_seconds": null,
      "text": "important thing is that we are able then"
    },
    {
      "index": 279,
      "start_seconds": 667,
      "source_timestamp": "11:07",
      "end_seconds": null,
      "text": "to pass all this information to the"
    },
    {
      "index": 280,
      "start_seconds": 668,
      "source_timestamp": "11:08",
      "end_seconds": null,
      "text": "auditors. So if we have some models that"
    },
    {
      "index": 281,
      "start_seconds": 672,
      "source_timestamp": "11:12",
      "end_seconds": null,
      "text": "are supporting it, some model that are"
    },
    {
      "index": 282,
      "start_seconds": 674,
      "source_timestamp": "11:14",
      "end_seconds": null,
      "text": "refusing it, and you know, they're not"
    },
    {
      "index": 283,
      "start_seconds": 676,
      "source_timestamp": "11:16",
      "end_seconds": null,
      "text": "really sure about that, actually we gave"
    },
    {
      "index": 284,
      "start_seconds": 679,
      "source_timestamp": "11:19",
      "end_seconds": null,
      "text": "all their thinking to the security"
    },
    {
      "index": 285,
      "start_seconds": 682,
      "source_timestamp": "11:22",
      "end_seconds": null,
      "text": "researcher, the human one, the the real"
    },
    {
      "index": 286,
      "start_seconds": 683,
      "source_timestamp": "11:23",
      "end_seconds": null,
      "text": "one, in order to be able then to to"
    },
    {
      "index": 287,
      "start_seconds": 686,
      "source_timestamp": "11:26",
      "end_seconds": null,
      "text": "judge this."
    },
    {
      "index": 288,
      "start_seconds": 689,
      "source_timestamp": "11:29",
      "end_seconds": null,
      "text": "At the end of the process, we have this"
    },
    {
      "index": 289,
      "start_seconds": 691,
      "source_timestamp": "11:31",
      "end_seconds": null,
      "text": "last part that is"
    },
    {
      "index": 290,
      "start_seconds": 693,
      "source_timestamp": "11:33",
      "end_seconds": null,
      "text": "you know, a sort of health health check."
    },
    {
      "index": 291,
      "start_seconds": 696,
      "source_timestamp": "11:36",
      "end_seconds": null,
      "text": "So sometimes, you know, our models, you"
    },
    {
      "index": 292,
      "start_seconds": 699,
      "source_timestamp": "11:39",
      "end_seconds": null,
      "text": "know, we use all of them, can"
    },
    {
      "index": 293,
      "start_seconds": 703,
      "source_timestamp": "11:43",
      "end_seconds": null,
      "text": "you know, give no verdict or giving no"
    },
    {
      "index": 294,
      "start_seconds": 705,
      "source_timestamp": "11:45",
      "end_seconds": null,
      "text": "candidates or just not read the scope."
    },
    {
      "index": 295,
      "start_seconds": 708,
      "source_timestamp": "11:48",
      "end_seconds": null,
      "text": "So it's very important that your harness"
    },
    {
      "index": 296,
      "start_seconds": 711,
      "source_timestamp": "11:51",
      "end_seconds": null,
      "text": "is able to identify that, to be aware of"
    },
    {
      "index": 297,
      "start_seconds": 713,
      "source_timestamp": "11:53",
      "end_seconds": null,
      "text": "that because we are tracking it and then"
    },
    {
      "index": 298,
      "start_seconds": 716,
      "source_timestamp": "11:56",
      "end_seconds": null,
      "text": "be able to rerun it. So if, I don't"
    },
    {
      "index": 299,
      "start_seconds": 718,
      "source_timestamp": "11:58",
      "end_seconds": null,
      "text": "know, a part of the code base has not"
    },
    {
      "index": 300,
      "start_seconds": 720,
      "source_timestamp": "12:00",
      "end_seconds": null,
      "text": "been checked or if a part of the"
    },
    {
      "index": 301,
      "start_seconds": 722,
      "source_timestamp": "12:02",
      "end_seconds": null,
      "text": "architecture is still not checked or"
    },
    {
      "index": 302,
      "start_seconds": 726,
      "source_timestamp": "12:06",
      "end_seconds": null,
      "text": "we are unsure about it, we have to"
    },
    {
      "index": 303,
      "start_seconds": 728,
      "source_timestamp": "12:08",
      "end_seconds": null,
      "text": "iterate about that or at least we have"
    },
    {
      "index": 304,
      "start_seconds": 730,
      "source_timestamp": "12:10",
      "end_seconds": null,
      "text": "to let the auditors, the human the human"
    },
    {
      "index": 305,
      "start_seconds": 732,
      "source_timestamp": "12:12",
      "end_seconds": null,
      "text": "auditors be aware of it in order then"
    },
    {
      "index": 306,
      "start_seconds": 736,
      "source_timestamp": "12:16",
      "end_seconds": null,
      "text": "that they can then just go through it"
    },
    {
      "index": 307,
      "start_seconds": 738,
      "source_timestamp": "12:18",
      "end_seconds": null,
      "text": "manually and check it."
    },
    {
      "index": 308,
      "start_seconds": 741,
      "source_timestamp": "12:21",
      "end_seconds": null,
      "text": "So this is our model. Actually we"
    },
    {
      "index": 309,
      "start_seconds": 743,
      "source_timestamp": "12:23",
      "end_seconds": null,
      "text": "implemented it through our tool that is"
    },
    {
      "index": 310,
      "start_seconds": 745,
      "source_timestamp": "12:25",
      "end_seconds": null,
      "text": "called Hive and you can actually get"
    },
    {
      "index": 311,
      "start_seconds": 748,
      "source_timestamp": "12:28",
      "end_seconds": null,
      "text": "more information on our website that is"
    },
    {
      "index": 312,
      "start_seconds": 750,
      "source_timestamp": "12:30",
      "end_seconds": null,
      "text": "oxsecurity.io."
    },
    {
      "index": 313,
      "start_seconds": 752,
      "source_timestamp": "12:32",
      "end_seconds": null,
      "text": "Um"
    },
    {
      "index": 314,
      "start_seconds": 754,
      "source_timestamp": "12:34",
      "end_seconds": null,
      "text": "um our tool is something that you can"
    },
    {
      "index": 315,
      "start_seconds": 758,
      "source_timestamp": "12:38",
      "end_seconds": null,
      "text": "use if you reach us to us, but the"
    },
    {
      "index": 316,
      "start_seconds": 760,
      "source_timestamp": "12:40",
      "end_seconds": null,
      "text": "methodology is something that you can"
    },
    {
      "index": 317,
      "start_seconds": 762,
      "source_timestamp": "12:42",
      "end_seconds": null,
      "text": "they can use as you want because is"
    },
    {
      "index": 318,
      "start_seconds": 764,
      "source_timestamp": "12:44",
      "end_seconds": null,
      "text": "something that is not really dependent"
    },
    {
      "index": 319,
      "start_seconds": 766,
      "source_timestamp": "12:46",
      "end_seconds": null,
      "text": "on models or technology. And that's all."
    },
    {
      "index": 320,
      "start_seconds": 769,
      "source_timestamp": "12:49",
      "end_seconds": null,
      "text": "If you want to reach out for for trying"
    },
    {
      "index": 321,
      "start_seconds": 772,
      "source_timestamp": "12:52",
      "end_seconds": null,
      "text": "it or just have any question, I'll be"
    },
    {
      "index": 322,
      "start_seconds": 774,
      "source_timestamp": "12:54",
      "end_seconds": null,
      "text": "here. Thank you."
    }
  ]
}
