0:03I'm so myself and Christian are here to talk about modern customer security engineering can I get a quick show of hands for anybody that knows what customer security engineering is perfect nobody can contradict us then that works really well quick way of introductions this is Christian Cortez senior software engineer he works developing our software he's built the stuff that we're going to show today he's also So, Ireland's first AWS Golden Jacket recipient, and a Coochrot. I am also here. So, I am a tech lead within the customer security team, and I have built and architected some of the previous iterations of the system as well. So, customer security at eBay. So, you now know who we are, and maybe the next thing is, why are you guys talking about Well, eBay is one of the few companies who have a customer security engineering team.

0:56to help define what that is, we're less focused on things like vulnerabilities and network intrusions and things of that nature. We're a security team who are orientated entirely around protecting eBay customers from becoming the victims of cybercrime or fraud on the platform. So we're dealing with stolen credentials and stolen information and trying to prevent that from being used on platform. Our team has been around for seven years and we've protected It's actually tens of millions of eBay customers. As well as protecting tens of millions of eBay customers, we've also banned over 6 million illicit accounts as well. Because when you operate an e-commerce marketplace, trust is the number one primitive, right? You need to feel that you can trust the platform you're dealing with, which is why eBay have invested this.

1:44There's not many companies who have customer security engineering teams. eBay were one of the first. So what we do is we turn insight. from you know that the landscape and that's what we have to be aware of the landscape of this data is being shared and we try and turn that into actionable signals that our partner teams can use to protect customers on the platform so we're going to talk about the future of customer security engineering and i think it's also the near-term future of customer security engineering because i think what we think about as a customer is being disrupted so this number feels slightly low now so it's in 393 this is from an adobe Digital Insights 2026, year -on -year increase in AI -driven traffic to US retailers, okay? And by March, they were 42 % more likely to convert. So in the other sessions that we've heard so far, it's maybe more like 1 ,000%, right?

2:33But it's not only customers who are using AI, it's also the cyber criminals. So there's that kind of duality of what we're trying to do. So Agenda Commerce is opening up new challenges to us. OK, so as I mentioned, not only are customers adopting it, but cybercriminals are. And AI -assisted cybercriminals can not only do more than they could before, but they do it faster. So Grant the CISO was talking yesterday about the arms race, right, and how they're not incumbent with organizational, you know, constraints, right? So they are maybe have a bit of a head start in that race. I think the other thing about skill and speed is, and this is something that we've talked about in a few different places, I don't think it remains. the need for partners. I just was in the last session on phishing, which was between Microsoft and Cloudflare, partnering to bring down global phishing issues.

3:25And then the one before that was with SZA, and that was, again, about partnerships. So I think the title of their talk is probably really key here, which is Nobody Defends Alone. And that's still the case here. Even if we can move faster, having partnerships is so important to us. So customer security needs intelligence. So I think a lot of, one of the key topics that I've seen in the other sessions I've been in has been around understanding agentic identity and intent. So that's a really important part. So yesterday there was talk about trusted agent delegation and other things like that. So that's a really key thing that everybody in the industry is trying to work on. So even if we haven't, when intent is deferred, how do we position trust going forward? So we're going to talk a little bit about why.

4:12we decided to make a shift step in what we were doing, why we picked Cloudflare to do that, and what we're building going forward with an example of that. So this is a quote from our CEO. He's used it a lot, and it's, don't AI enable the past, but AI invent the future. And that's how we felt about our existing systems. They were working, but the landscape was shifting at an unprecedented pace and trying to tinker with and update and augment our existing. systems to manage that didn't feel right. So we thought we needed to take it from a new paradigm and basically combat agentic attacks with agentic defense. So we went to Cloudflare because it's security focused, not only because, you know, it's a very secure platform, but also from a security partnership that we have. We also were looking at a platform that develops at the speed of AI.

5:01I don't know if anybody else is struggling to keep up with all the updates and product releases that are going on, right? The developer platform that we're... using now is completely different to the one at the start of the year in a positive way, right? It's built for agents. And that's what we mean when we say built for what's next. CloudFare seemed targeted on the agentic web. It seemed to be dealing with those primitives. They seem to have an understanding of those and identifying agents and understanding them. It's not like the right place to build what we needed to build. And I'm going to pass it over to Christian. Thank you, Patrick. So Cyber criminals are moving at the speed of AI. What does it mean? Just a cliché, maybe. What is the speed of AI? So for us, I spend a lot of my time reading chain clocks, and this is because every new model that gets released represents an opportunity for us to be better, to be faster, to be more effective.

5:56But at the same time, if a cyber criminal detects a possibility to gain advantage, it won't... hesitate it will act immediately the cyber criminal doesn't have a legal thing to go to if they need to onboard a new model they will just go for it so that forces us to stay ahead of the emerging trends i would say um i was thinking of an example to illustrate this problem at some point system one models appear you know these are fast classifiers we've been using classical models to classify and, of course, they are not good at that. At some point, JEP appeared that there's an emerging trend there.

6:42And we spent some time identifying our system where can I implement a System 1 model, which lead us to a few weeks of investigation from JEP. To give you the example, we have, for us, it's important to know resources. As Patrick explained before, we have a... venues, underground venues, where we collect data. These venues have a life cycle, and basically for us it's very important to rank them before we decide how we are going to use the resources to to extract the data from them. Some time ago we have implemented a ranking, so we have a ranking that was determined easy for this. This involves a lot of data, grabbing samples, adding historical metrics we know from the venues, and then basically rank them.

7:29AI ranking with the classical model that took around, and we do this in batches, but took around like 10 seconds to complete. When the, I think, you know, Clef and Clef Flash were launched by a few weeks ago, were launched by Cloudflare. They launched a system one model which serves to classify, so for this purpose, they launched on a Thursday, on a Friday we have it working, because we already did our homework, we know where to swap it. result is like now we have the ranking of these batches under one second consistently. We rank all the time, every four hours, which we have a job to do this kind of ranking. So I think that shows very good how, you know, we are doing this. I think my colleague Patrick, 72 hours later, find another use case for brand protection and phishing, because we knew, I think share -based 0.042 per 1 million inputs.

8:26Clef flash is 0 .09 per 1 million input tokens, but it has a larger context windows and support images which allow Patrick to use that for phishing detection as well. Okay, so I'm here to talk to you about Project Starlord. Project Starlord is what is describing the year we have. Project Starlord has three objectives. The first one was to migrate the Kubernetes collection pipeline that we have in a different cloud into Cloudflare. The second objective was putting a harness for security engineers and full stack operators. If that is not ambitious enough for one year, we wanted to make it fully authentic. When I talk about fully authentic means once the pipeline is up and running, we need to have agents to monitor the different type of collections.

9:15We need to have agents to share a report for metrics and we need to have agents to basically do their own code. in example starting workflows from Cloudflare. I think we went over this but I will go very fast I know your product space will be different than us but just to remind you we collect for these underground venues, we do ETL jobs, we generate actionable insights, for some of them we act directly and for the other use cases we generate signals so other departments between eBay can take

9:52So, this was our objective. The other part is telling you probably what, which, the other question is like, what are you using from Cloudflare? And the quick response will be pretty much everything, right? We use pretty much everything from D1 to KVStore, R2. So I was thinking, which are the critical parts that help us? the migration. I would say I'm pretty happy for the data catalog team. We store a lot of data in R2. I know if you're familiar, but you can run R2 SQL. They have Apache Iceberg, so you can have your own data catalog to help do SQL on top of the venues data. And we handle that into the applications as well for giving us insights.

10:38As you can think, these venues are in different languages, so AI is there to help us translate, to detect intent, and to go for opportunities as well. Another services which I love, I think, is the other part of the cornerstone is the containers. Containers are super powerful. You can have container placement for different regions. We find cases where we need to spin our containers in a particular region to satisfy the need of finding cybercriminals. I are targeting customers from a... or from UK. So that's another feature we use a lot. On top of that we use workflows. Workflows are super powerful. We use workflow to ingest not only our collection, also to consume signals that come from third-party vendors that collect similar information that we lately aggregate.

11:30And I'm here to tell you now why we needed a harness. We need a harness for security, for researchers. And the lesson learned is here, we started back in January. And there was open club. There was not the name in January, December, when we started. It was mobile and changed names. But we wanted to have a harness where security researcher can go and start turning his job into something that is AI-assisted initially. which means they will develop the tools, the MCP tools, to share reports to automate certain actions they do on top of these venues and this was a great decision. We started earlier with this.

12:23We didn't give them the perfect hardness from the beginning. We just gave them something on top of which they can start creating MCP tools and start evolving them and start making them more mature. This was fundamental for us later on. The other thing is, of course, having skilled jobs, which is something that Open Cloud supports.

12:48Let's see how it all aligns together. I think it was February. Cloudflare launches ModWorker, that is basically the combination of Open Cloud running in a container attached to a worker. Of course, we jump immediately into this. And that was the other part. We didn't want to bring our own key and have external models. We want everything to be running in Cloudflare. So we collaborated with them. So they enabled for us using directly the workers' AI. So that's the other part we use as well. Like AI gateways have been for us super useful. We continue evolving. At some part, we have this idea to invent and simplify. And we say, we really don't need all this layer of open.

13:34What's inside OpenClaw is a Pi coordination. So we started developing our own harness inspired in Pi coordination. As you know, if you are Pi users, such as myself in the past, there's no direct support for MCP tools. So we need to either go for a plugin or develop that logic ourselves.

13:57And to prove we were going exactly in the same direction as Cloud, at some point, Cloudflare announced the Think framework. is something that was, as well, deeply inspired in the PI coordination, which solved for us all the needs we have for sessions, for organizing the sessions, loading the tools. So when we see that, it says, like, there's no more need for us to continue maintaining our own extension on top of the PI coordination. So we migrated to Think.

14:32At some point, our architecture looked like this.

14:37We have the worker, we have the think harness, think about UI, like similar to chat GPT UI that you have, or better than that, similar to Cloudflare OS, okay, that where the researchers can contribute, how they chat the sessions, we load the tools, We can assign them the models directly from Cloudflare, and then the initial versions we needed this, we attach containers, containers with Docker file images where the researchers can have their utilities and perform analysis directly on the cloud. And this is as well the power of the edge locations, because sometimes being near, putting it near to the edge location where the venue of the...

15:26of the cyber criminal is hosted, gives an amount, is an incredible advantage, okay? And this let them start working their own NCPs or have NCP versions of the APIs and tools they were working on. We mounted everything on the file system, just a few folders initially that were mounted in R2 that we need to survive across container restarts. we have to develop a browser for the agent and then we have the workflows with the third party that i that i explained earlier we consume with not only our rsql data catalog we use signals from third parties as well if you need to do it today this change as well this is a snapshot of the bus we don't have containers except for rare cases where we need it we try to avoid because it's a surface area of, you know, like we need to maintain a Docker, a golden Docker image and we don't want to get back there.

16:29So we use code mode and for storage we use artifacts. Right now we are, we solve the problem as well of agent orchestration. Right now this is very simple. Our agents don't have access to internet. We created as much tools to provide metrics and interaction that they live in a closed circle. and all they know is what we provide to the MCP tools. So these artifacts is like a Git -like file system that the agents can use. And there's not only one of them. They work in a group. They have a hierarchy. We have an architect agent that is the one that sometimes gives the tasks to the other agents and leads. So they work in an org chart if you are familiar with GAST.

17:18or Symfony, OpenAI, you will know what I'm talking about, or Paperclip. And the good part is like now they have the tools to do the on-call and they have other funny parts like they generate reports. We don't have to go and have this assistive part of generating reports. Every morning I get to the office and I see that the agent has a stand -up, right? So I can read what they identify, they are the action items, and how they correlate the metrics. metrics. What can I tell us results? One of the results is, compared with previous year, we increased five times the amount of protective actions. And now my colleague Patrick is going to tell you a bit more. Yeah, thanks, Christian. So Starlord is probably more of an example than a blueprint for everyone else to follow, right?

18:07It was talking about a problem that we had, which was that it's hard to keep up with the shifts in the landscape and underground venues that be due to the platforms themselves disrupting those venues it could be law enforcement it could be other things the speed of that adaptation is increased dramatically so we need it to increase as well when you see these numbers that we have you know raw object collection of um of five times i think if we'd stayed still we wouldn't have got one x of last year right because it had been disrupted so much we needed to change our pace of adaptation to be able to match it as well so when we think about the next step for us. There's a few different things that we want to do. We're looking to scale without linear operations. What does that mean? Well, it means that before it would have taken a significant time investment to be able to collect from different platforms, different types of places where data is being shared. That is no longer the case.

18:59We can adapt so much more quickly to get into some of these areas to access data. We also are continuously redrawing the boundary. So agentic engineering may have lowered the cost of building software. It hasn't quite had the same effect on the cost of owning software. It's happening, but not quite the same way. So we need partners. We still have partners. There's been a huge shift from all third-party collection to primarily first-party collection, which is what we're doing with Starlord, but we still have third parties to augment and support us with that. And then the next thing for us as well is that we're moving from agent identification to agent intelligence. We've talked about customer engineering. If an agent is a delegate of a customer, we need to think about how we can think about the security of that delegate, right?

19:46ATO used to mean account takeover. Maybe now it means agent takeover. So our mission is the same. We just think that customer security engineering can't be treated like any other security team. We have to treat it as a platform engineering move. And that's what we do and we'll continue to do. I think we're absolutely out of time. So I just wanted to thank everybody for listening to us today. Thank you very much.