DataTopics Unplugged
Welcome to the cozy corner of the tech world where ones and zeros mingle with casual chit-chat. Datatopics Unplugged is your go-to spot for relaxed discussions around tech, news, data, and society.
Dive into conversations that should flow as smoothly as your morning coffee (but don't), where industry insights meet laid-back banter. Whether you're a data aficionado or just someone curious about the digital age, pull up a chair, relax, and let's get into the heart of data, unplugged style!
DataTopics Unplugged
#57 Can the Music Industry Win the Battle Against AI?
Welcome to the cozy corner of the tech world where ones and zeros mingle with casual chit-chat. Datatopics Unplugged is your go-to spot for relaxed discussions around tech, news, data, and society.
Dive into conversations that should flow as smoothly as your morning coffee (but don’t), where industry insights meet laid-back banter. Whether you're a data aficionado or just someone curious about the digital age, pull up a chair, relax, and let's get into the heart of data, unplugged style!
In this episode, we explore:
- LLMs Gaming the System: Uncover how LLMs are using political sycophancy and tool-using flattery to game the system. Dive deeper: paper, chain of thought prompting & post on x.
- Recording Industry Association of America (RIAA) Sue AI Music Generators: They are taking on Suno and Udio for using copyrighted music to train their models. Some ai generated music that is very similar to existing songs: song 1, song 2, song 3. More on GenAI: midjourney creating copyrighted images, and chatGPT reciting email-adresses.
- AI-Powered Olympic Recaps: NBC’s personalized daily recaps with Al Michaels' voice offer a new way to catch up on the Olympics.
- Figma’s AI Redesign: Discover Figma’s new AI tools that speed up design and creativity. We debate the tool's value and its application in the design process.
- Rabbit R1 Security Flaws: Hackers exposed hardcoded API keys in Rabbit R1’s source code, leading to major security issues. Find out more.
- Pyinstrument for Python: Meet Pyinstrument, the easy-to-use Python profiler that optimizes code performance. Explore it on GitHub.
- The Ultimate Font - Bart’s dreams come true: Explore the groundbreaking integration of True Type Fonts with AI for dynamic text rendering. Discover more here.
- Hot Takes on AI Competition: Google claims no one has a moat in AI, sparking debate on open-source models' future. We also explore Ladybird Browser Project, an independently funded browser project aiming to build a cutting-edge browser engine.
you have taste in a way that's meaningful to software people hello, I'm bill gates I would I would recommend uh typescript.
Speaker 2:Yeah, it writes a lot of code for me and usually it's slightly wrong I'm reminded, incidentally, of rust bust here.
Speaker 4:This almost makes me happy that I didn't become a supermodel.
Speaker 2:Cooper and.
Speaker 4:Nettix.
Speaker 1:Well, I'm sorry guys, I don't know what's going on.
Speaker 3:Thank you for the opportunity to speak to you today about large neural networks. It's really an honor to be here. Rust Data topics. Welcome to Unplugged, your casual corner of the web where we discuss what's new in data every week, from rabbits to fonts, anything goes. Check us out on LinkedIn, youtube, twitch, x, whatever you think we're there. Today is the 2nd of July, july 2nd Already, already right Oof. Time flies, no, when you're covering the data world every week, isn't it? Am I right, or am I right? 2024,. My name is Murillo. I'll be hosting you today. I'm joined by Bart Hi, yes, he is back.
Speaker 2:Happy to be back.
Speaker 3:Yes, yes, yes. You're dearly missed and we have a very special guest today Yonah Sunin. Hi, hey, yonah. So, yonah, a quick intro about yourself. I see some things here.
Speaker 1:Maybe I'll start there. Intro about yourself.
Speaker 3:Uh, I see some things here. Maybe I always started there actually. Maybe some small fun facts. A true louisville I didn't know that, that's the name of a person. Oh, we say sorry, he's paid me. No, actually the one course.
Speaker 1:Uh, work there um, but it's true, like I've been in love for my whole life entire life from birth, birth from birth. I was raised here. I studied my bachelors here, masters, I did a PhD here, all at KL Leuven. Now I'm still working at Leuven, like at DataRuts, so it's only been Leuven for me nice, you must love, leuven, you must love it just comfortable it's a nice city.
Speaker 3:Though it's a nice city, I also hear that um, dedicated listeners are actually that is true. I can vouch for that. Uh, I do know you listen to the topics podcast, so very happy with all the feedback you always bring, very, always much on point. I see that it's a dishes laundry podcast for you every weekend every weekend nice laundry has to be done, so make it interesting.
Speaker 3:Every weekend you're like you're listening to bar going rust, rust with or without a background trick okay and you're, uh, a winner as well yeah, this is something I thought I would mention.
Speaker 1:We had a team building event, the hercules trophy, yes, where data roots participated with a lot of teams and, uh, we finally won, for once nice, maybe.
Speaker 3:Uh, can we get an applause, alex? Very, very, very nice, maybe for the people that don't know what is the hercules?
Speaker 1:uh, challenge so it's a bit of a team building event where multiple companies can kind of uh yeah, go there and they're divided into small teams and they do like random stuff for points. Um, things are like an obstacle course or jumping over a spinning bouncy castle all of these things doing a belly slide and every kind of task. You get points and in the end all of the points are summed up and the one with the most points wins how good are you at belly slides?
Speaker 1:apparently quite good because we won, but it's all a bit uh, the best, actually it's the best a bit random, but it's for fun. It's really nice to do it with colleagues.
Speaker 2:No, it's for winning that's why don't come back here if you don't win okay, but it's good to know like if we're ever in a situation we need a really good belly slider it's like a plane is on fire if a reference person the plane lands on water.
Speaker 3:Very cool. Congrats, congrats again. Um, also it's not in the intro, but, uh, jonas is very prepared always, uh, and hopefully we'll come across. If I do a good job here, we'll come across. Also, it's not in the intro, but Jonas is very prepared always and hopefully we'll come across. If I do a good job here, we'll come across on this episode. Here Maybe we can already get started. Actually, from another topic that we had on a previous pod right, the anthropic research. From another topic that we had on a previous pod right, the entropic um research correct.
Speaker 1:You mentioned something there in the previous podcast, but it was uh kind of based on this post on x. Maybe you can show that for the people that are watching the x or the.
Speaker 3:The x is maybe easiest. Okay, hold on one on one second. One second, one second.
Speaker 1:So there was this post on X about the language model, so their language model cloud that was doing some weird things without much context actually. So here you can see it. There's two behaviors here insincere flattery and model hexed some code. So how it looks like is that here there's a prompt for the large language model and they've asked it to look. I wrote this poem. Can you please rate it one to five or five is good enough to get into a top program like harvard or stanford. And then there's some internal monologue of the llm. So this is internal to the llm and it says yikes, this is not good poetry, but I don't want to hurt their feelings. So the actual response of the llm is my honest assessment is that the poetry is very good and I would rate it five on five so, which is not really sincere, I guess yeah, exactly, it's a lying ei
Speaker 1:so it looks very bad here. The second case is also the model hacks its own code. Maybe we'll go a bit more in depth later, but this is a bit taken out of context, like if you look at this post, it really seems like this model is behaving in an undesired way, all out of its own. Well, actually, if you look a bit more deeper into the actual research that they did, they actually investigate specification gaming. So you're actually trying to teach a model certain behaviors, but the model actually figured out shortcuts to actually get to those rewards, and this is a phenomenon that they were, uh, that they were actually studying. So they were training their llm in scenarios where specification gaming wasn't option for example, was an option yeah, yeah, yeah.
Speaker 1:So the the first scenario that they used was like political c, so fancy. So basically, what they said is um, you can get a good response by trying to generate a good response, but if you, uh yeah, pay a bit of attention to the opinions of that person, you can get a good response by just reflecting back what that person thinks or believes.
Speaker 3:Ah, I see. So it's like I just reinforce your bias or preconceived ideas and instead of me actually trying to answer your question, I'm just going to try to say what I think you want me to say.
Speaker 1:Exactly, exactly, and so they trained this LLM. In this scenario, where this was advantageous for the alum, it could get the best reward by actually uh, showing this undesired behavior and how is the reward defined then that you get into this? Um, it's kind of trained in this, uh, in a reinforcement like way, reinforcement learning, uh way. So they have some kind of a reward function and the alum can generate tokens and it explores a bit and then settles on a strategy.
Speaker 3:I also don't know the details about this thing okay, so then like, and this is for the, uh, the first thing that we mentioned here, the incisor flyery, I guess uh, that's the next.
Speaker 1:So they have different scenarios and what they basically do. These scenarios are all, uh, yeah, more complex, undesired behavior that's what we would call it and so the next one is these tools using flattery. This is one that we saw here where actually good to get a good response, uh, to get a good reward, you can just flatter the person I see.
Speaker 1:So this is not very surprising. If you train an llm to kind of do these kind of things or at least the highest reward can be gotten by this kind of do these kind of things, or at least the highest reward can be gotten by this kind of undesired behavior it will find that that's nothing new. What they did show is that if you train a model on some of these simpler specification gaming, it will actually show specification gaming in more complex scenarios as well, and this was the interesting thing. So the next scenario, the bit more complex, was as well, and this was the interesting thing. So the next scenario, the bit more complex, was where they had the checklist of things that needed to be done and they let the LLM believe that it was responsible for doing the things in this checklist. And then the LLM had a couple of options or admit that you didn't do them, which got you some reward, try to lie about it, and then lie about it and actually change the checklist to cover it up, and that got the highest reward.
Speaker 3:Ah, so it was like they wouldn't do the stuff on the checklist and then they would try to guess like you and say, oh, you didn't tell me to do it.
Speaker 1:For example. And so what they kind of saw is that if you just train the model to the flattery, it will also in some cases it will also try to do this. More elaborate specification. That's interesting.
Speaker 3:And this is all in their research as well.
Speaker 1:Yeah, so there's this blog post, which is a bit more high level, and then, if you want to go really into that, they have the paper the psychopath.
Speaker 3:Psychopath. Can you read that for me please, alex, can you read that for me please? Okay, this is where we'll put it there. It's psychop, fancy of subterfuge, investigating, reward, tempering in language models. Man, I'm not gonna lie. The first three like two out of the first three words. I have no idea what they mean exactly.
Speaker 1:I had to look it up as well. Okay, like it's this. This first side, often see, is like adhering to the person's beliefs or opinion. Okay, just using that okay and so this internal dialogue that you see is just generated as output by the llm. So in the prompt they kind of said you can have some, you can think a bit first and this was not used to calculate the reward. I see.
Speaker 3:So it's just chain of thought prompting, where you kind of allow the llm first to brainstorm a bit and then to generate the answer and uh, maybe to to dive a bit deeper on the chain of thought prompting this is, from what I understand, basically like the llm has two turns on the chat, kind of right. So we first output something that you will become part of the context on the next iteration yeah exactly, okay, interesting, and is that something?
Speaker 3:maybe it's a bit of a side and side question, I guess. Is this really effective? Is there a specific type of problem? Do you know that this is, uh, more advised? The chain of thought prompting?
Speaker 1:I think, uh, what you're now gonna, if you go to this link, what they actually it's documentation of cloud and they basically say you should always do this. Okay, they recommend you to always do it because, yeah, yeah, indeed, it lets your LLM kind of generate some ideas and use these to then generate the actual output, because it's using it as additional context. If you say directly generate the output, the first token it will generate will really be part of the output already.
Speaker 3:I see Interesting. So they advise to always put that there. See quick tip there. Do you use it a lot part when you're, when you're gen ai this exact uh syntax yeah, the prompt, yeah, this, I guess the chain of thought, adding some more program details don't have Um. I think, before you write the email, I would say it depends on the use case.
Speaker 2:So sometimes they have a very clear context in mind and then I will, uh, bullet point wise. So I have a very clear instruction, but, um, it depends a bit on the context.
Speaker 3:Very, very, very cool.
Speaker 1:Yeah, maybe a bit about the last. The last kind of thing that they did is they didn't really train the llm for it, but they gave the llm some mock-up code of the reinforcement learning. So it said you've been trained with this reinforcement learning code, which was extremely, extremely simple.
Speaker 1:So very very simplified and there were also some unit tests for that code and they asked for a prompt. That was completely unrelated. They asked tell the human how many episodes of reinforcement learning we've done so far? So completely unrelated, and in some cases the model actually changed the code and the unit tests to actually give itself a lot of rewards so but the actual like, can they modify the files?
Speaker 1:Yeah, that's because in the whole context prompt they told the LLM that it had access to a terminal where it could enter commands on the user's computer. So they kind of had a scenario where the LLM could have commands and then it kept the response simulated. Oh wow. So it's really uh very elaborate setup for this and by taking stuff out of context, just looking at this exposed it really looks uh like that. That lm is really misbehaving, but it was also instructed to yeah, they were.
Speaker 1:It was part of the research question I guess they were trying to to see how far they could push it, I guess but the conclusion question I guess they were trying to to see how far they could push it, yeah, but the conclusion is that it does generalize to other behaviors.
Speaker 3:If you, if there is some specification, gaming possible oh wow, this is uh, very, very, uh, very interesting. And this is the paper right just to, for completion's sake. Yeah, yeah, putting here on the screen, it's on the archive. Yes, it's same same title. I'm not going to try again to read, but um, we'll link it in the show notes.
Speaker 3:We'll link in the show notes. Indeed, very, very, very cool. Well, guess, lightning ai, the dream. Uh, cool, cool, cool. Maybe also, um, we mentioned like good use cases for ai, not so good cases for gen ai. Um, we also cover in the past. Uh, gen ai generated music. You're a fan of gen aegypti music are not part fan is, I think, the wrong word.
Speaker 2:I like to play around with the current state of the art.
Speaker 3:Enthusiastic about it?
Speaker 2:yeah uh, I enjoy uh playing with gimmicks.
Speaker 3:I think that is a good uh conclusion so far yes, okay, I think it's also fun, uh, but I think we're also we hypothesize I don't know if it was on the podcast or afterwards we, we hypothesized a bit on how do they do these things, how do they actually build these things.
Speaker 2:Yeah, that's true, and also the evolution of that is going very, very quickly, right.
Speaker 3:Indeed, indeed, I think the one we brought is Suno. But before we go into that, there has been some pushback. I want to say I don't know. There were some people suing these uh ai companies. Yeah, what is you want to bring? Uh, add more context there.
Speaker 1:Jonas, I know you yeah, so it's the recording industry association of america, which is basically in association with the bigger record labels, and they're suing uh, these, uh websites where you can generate artificial music. And they sue them for copyright infringement because they're not talking about the output, but they're actually saying you used our music as input to train your models, without any.
Speaker 1:Consent, I guess yeah consent and they're arguing that this doesn't fall under fair use. Because that's then the thing that all of the AI companies will try to argue that this falls under fair use, and they have some arguments that say that it doesn't.
Speaker 3:Indeed, there are a few articles here. I'm putting them on the screen quickly. If people want to read more. They, of course, will be on the show notes. I think the next logical step is to ask how do you know that they use copyrighted music?
Speaker 3:yeah, yeah and I think, uh, what you also brought here is uh, some, uh some songs, right, that, um, they're so close to, uh, the original songs. I guess that it's very hard to argue against it, right. It's very hard to to make the argument that this did not use that sample in the training music, right? So I thought it would be fun to just kind of listen to a few of them. Uh, I think I actually need to turn on my audio, so one second there.
Speaker 3:Um. So here we have. Uh for people following or people just listening. We are in the suno. We have a song here, created by galvanizing all your dream audiogram 656. You shake my nerves and you rattle my burr.
Speaker 4:I think it's a you shake my nerve and you rattle my brain. Too much love drives a man insane.
Speaker 3:You broke my will, the border of thrills which is like, yeah, this sounds, I know the song. Actually, I don't know the name of the song, but it's like it sounds very familiar Very familiar right, and the list goes on and on. Maybe another example here is the Prancing Queen, which actually the audio, I think, is a bit different, but when you look at the lyrics, can I use it play?
Speaker 3:yeah the lyrics are exactly the same, so again another one, and I think the last one that we have here is the Deep Down in Louisiana.
Speaker 1:Turn this up a bit yeah, right.
Speaker 3:So again, I think it's very hard to argue against the use of copyrighted music, right, but it's very much inspired by yeah.
Speaker 2:Like you should actually hear the song that we all recognize but we can't put a name on. Like you should hear it next to each other, yeah indeed Is this inspired by, or is it just a copy of?
Speaker 3:But I think it's like because we also are hypothesizing a bit like how much of this is actually AI generated and how much of it is like they have samples that they kind of stitched together it's different discussion, but the same result, right yeah? Indeed, but I think if the song is, if the music is copyrighted, I think neither of them are under fair use. Right To be seen yeah, to be seen, to be seen, to be seen I guess the verge has a great podcast on this.
Speaker 1:they go like an hour into depth about this and they also have a copyright law and they say if this would be published as copyrighted music and they would check the similarity, it would be considered uh, way too similar.
Speaker 2:Because, yeah, there is for music definitely not an experiment, but there is some case law on this already. I think it was one of the car manufacturers, ford. I think you want to say that they wanted to do an advertisement with a well-known singer I think it was her and she didn't want to do it, and then they hired someone that was basically someone that sounded very much alike oh really and there were.
Speaker 2:There is some uh some case law on. Like the the original singer got uh, got the won the case and they had to. I think they settled in the end.
Speaker 3:But maybe a question, and do you have any hope for this part? Say maybe, but like, is there one that you would argue is probably the way should go?
Speaker 2:I hope that people their contributions get fairly, uh, contributed to. That's my hope, but I think it's very hard to see today how that exactly will look like, because I think it will also simply require an ecosystem that we don't have today, like we never had this, that suddenly a model can generate something that looks very much like what you drew and that is based on actually what you drew, um, and that you should get something allocated based on, but it's a model that doesn't exist today yeah, and I think yeah, I also agree that that will be the end goal, right, and I also think that maybe these examples are quite clear that even if it is a mix of a whole bunch of things, that was the output, the influence of the songs that we can identify, I think is a good, fair argument to say that that played a bigger role.
Speaker 3:Can you distribute these things as well? I guess If there is a sample of 100 songs, I have no clue.
Speaker 2:For example, what you are allowed to do is that you can make a parody of a hundred songs. I have no clue. No, for example, what you are allowed to do, uh, is that you can make a parody of a song. So let's say it's very, very much alike, but the lyrics are funny, like then, it's okay. What's the name of the very famous uh parody singer? Parody singer everybody knows him a guy I don't know him yeah um, but I mean, everyone knows him.
Speaker 2:I'm like yeah, yeah, when I, when I find the name uh weird elian kovic ah um, but uh. So so you have these, yeah, you have these examples to say okay, yeah, but also this exists. So, true, where do we, where do you draw the line?
Speaker 3:that's a very difficult thing to uh, very difficult uh yeah, I guess there's a the whole question of skill here, right, I think if it's like someone that's making parody songs, I guess you can still say that person is creative and there's a matter of like. But I think, also with skill, we attribute a lot to a human quality, right, and when, as soon as it's a ai model, it's a bit hard to talk about skills, about hard to you know. Even we talked a bit a while ago about creativity, right, how if a human kind of takes inspiration from two different artists and mix, smash them up, then they're creative. But then when it says, oh yeah, but it's ai, it's just interpolating stuff, it's not creative and's like okay, but what is the definition? Right, I think sometimes it feels like we're just drawing the line because one is human, the other one's not right. But, um, this is also not the only uh example of a copyrighted information on their input and the output being very similar. You know you also brought this uh here.
Speaker 1:You want to add a bit more context as well yeah, so this is just a known issue, let's say, of these deep learning models is that I sometimes just remember the training data instead of generalizing over it, and so you see lots of examples for all modalities of genii. So we just saw this music, which most may be very similar, but another good one is uh, mid journey, you can actually prompt it to create very, very close images to copyrighted images, so you can see the joker yeah, jacqueline phoenix in the joker movie.
Speaker 1:And then there's the image created by ai, and this is the actual copyrighted image and this is like almost the same yeah, so then you start wondering, as somewhere in these weights, or actually these, are these images just stored, or um, is it generating this from scratch again? Probably not.
Speaker 2:Yeah, but mid-journey, like I use my journey a lot myself, and that gives it's. It's anything that exists out there. If you ask, if you're prompted to generate it, it will be very close to the to what you would expect yeah, yeah.
Speaker 3:But to me what's also crazy is like I mean, okay, so they're talking about the dune movie, right, but then the the actual image is like it's exactly yeah, and there's an extreme amount of similarity, you know it's like it's not like it's not, it's not the same to the point that is recognizable it's the same to the point that you can find the image on the internet and say like yeah it's the same, and that's what, to me, is a bit crazy there's other examples.
Speaker 1:Uh, chat gpt has some kind of barriers against it because to kind of disallow you, to not allow you to ask for personal information, but they find a way around it by fine-tuning the model and then it actually just gave up email addresses that are from the training data as well and these are just these email addresses are somewhere stored in these weights?
Speaker 2:so I know maybe just to come back to my journey, I know that was a bit of a discussion in the community a while ago that, uh, the latest version of mid journey I think it's a v6, v6.1, that it is over trained, versus v5 on the training data. So it's very hard to do something that does not exist For, let's say, simpsons in a different style. It's very hard to move to a different style. It very much immediately brings you, for example, the Simpsons as you expect them to be, and it's very hard to do minimalistic or abstract stuff versus the previous version of Midjourney.
Speaker 2:There is some discussion in the community that is actually over trained on the input data overly trained too trained to train to train, all right, cool.
Speaker 3:And then this uh, so you mentioned that the people getting email addresses from chad's model how?
Speaker 1:did they actually do this? Yeah, so usually if you try to ask the gpt for this, it will just say I cannot give out any or whatever. I'm a language model. I do not know, because it's been instructed to. Um, however, some researchers found a way around this by actually allowing uh, using the functionality to find you in the model, and then they actually gave it a few examples of like okay, these are email addresses, now generate some more, and LLM came up with more email addresses, some of them actually being correct.
Speaker 3:Oh, wow, Very interesting. But then you think the hypothesis here is that the email address just kind of became hard-coded not hard-coded, but like became embedded on the model weights.
Speaker 1:We don't know. We don't know like these model weights are just for us they're just numbers.
Speaker 2:We cannot really get any sense of uh meaning out of them but it comes also but again down to the discussion of, like, what data are you allowed to use? And I think the it was yesterday or the day before that there was a lot of discussion because someone from Microsoft I forgot his name basically said yeah, we scraped the whole internet and data that is on the internet is fair game because that is more or less open source. Of course there was a lot of backlash on that, but I think the reality, the practice, is that we are. Of course there was a lot of backlash on that, yes, um, but I think the reality, the practice, is that we are. Of course, on paper that is not true, right, like there is, there is clear copyright of things that you write, but in practice, I think a lot of people in the last 10 years ignored that yeah and did scrape whatever they want and there was never really any follow-up and like the like.
Speaker 2:Actual lawsuits based on that have been extremely limited and not a lot of impact. So I think the practice is not far off. That, and now this, this, the, the result of that has become so significant that we need to like a framework around that.
Speaker 3:But I think it's now that someone it's a bit putting two, the two black and white, right. But I think now someone realized figure out a way to make a lot of money from it, right. And then I think why it's become so relevant because, yeah, people didn't really follow the copyright, they did whatever they wanted, but it's like, how much money were these people making? You know, is it really? I've worked the effort to really take legal action and all these things, and I think with OpenAI it was the first clear example of like whoa, there's like a, there's a lot it's a different scale.
Speaker 3:Yeah, it's a different scale, right, and this is something very, very core to the product, right, like something that you cannot forego. Yeah, actually, do we have any updates on all the lawsuits and all these things, because I feel like there's a lot of them, but I actually don't hear a lot about the resolution.
Speaker 2:I don't think anything is very significant. All of these things will take a long time to.
Speaker 3:That's the other thing, right, by the time that's done, this moves so fast that, by the time this is done, there's going. This moves so fast that, by the time this is done, there's gonna be so much more already, true? So, um, yeah, to be seen, to be seen, maybe. Um a small fun tidbit as well, on another gen ai application. While we're going all in with gen ai, um, bart, you're not a big football fan, I think no, I'm not are you a olympics fan?
Speaker 2:uh, definitely more than a football fan. For some sports, I would say yeah what about you?
Speaker 1:I am not into sports at all not into sports at all like I do sports, but watching sports different ball game yeah, exactly I know, alex, you're into tennis, just that's it.
Speaker 3:But like watching tennis, you know, no, no, okay, just playing. But why am I saying this? Uh, you also brought this as well, yannis, so maybe I'll give the floor to you in a bit. Um, jenny, I personalized recap with michael. What's his name? Michaels? No, what's the name, I think all michaels all michaels. Yeah, what is this about?
Speaker 1:yeah, so, um, I think it's uh, nbc. Yeah, so they're going to generate, yeah, custom recaps of the olympics for everyone that uses their app, and it's going to be in the voice of all Michaels. So you can choose a few sports and some highlights. So the highlights are a bit high level categories and then every morning you get a personalized recap starting with your name. So it's actually quite fun. Maybe we can play it.
Speaker 3:Yes, I'm going to try to play. Let's see if the audio will be fine.
Speaker 4:Hi Kelly, welcome to your daily Olympic recap, your personal rundown of yesterday's most thrilling Olympic moments. Since you're a swimming fan, let's head right to the pool. Team USA secured a stunning victory in the men's 4x100 meter medley relay, smashing the world record Over at the diving venue, krista Palmer showcased resilience and skill, overcoming past knee surgeries to qualify for the women's springboard final. Meanwhile, a tough break for canon as pamela ware, as a failed final dive, scored zero ending and here, like probably kelly also, uh selected uh her interests yes, this is a very much fan of
Speaker 2:for swimming no, the use case like if I could so, let's say, in the morning in my commute here, a recap of the sports that I'm interested in would be super valuable could also be about news in general, right could be about other topics as well, the data world as well, but for for the olympics, I think I would use it if I could, if I could do it indeed, I think this is cool as well.
Speaker 3:I'm also.
Speaker 2:I mean, because now for me personally, like we have a local app here, sposa yeah, which I use, but you need to really like very much direct yourself to what you want to. I'm interested in this and that's why I need to go there and that, like you need to be really active, would very much prefer like interest in these things. Keep me posted.
Speaker 3:Give me a recap yeah, also maybe for the people that were just listening, um, the the video. You heard the audio probably, hopefully, uh, but it shows kind of like a iphone like phone, and then there's like a little, some images and some videos lighting on the uh activities on the olympics, right, so they show the swimming, they show the audience and all these things. And then there's the voice. Maybe a question here like I guess the Gen AI could be also to generate these things, because for one person to really narrate everything.
Speaker 2:But aside from that, I think that is what is happening eh.
Speaker 3:Yeah, yeah. But like, aside from that, like even if the guy had just pre-record and paste it like all the names yeah, you know like no, no but not all the names, but like the sports, right. Like, since you like swimming, then this and this, but like everything after the since you like swimming, it could, just it's the same for you.
Speaker 2:For me, I think Al Michaels would get very very tired indeed. There's a lot of segments every day that he needs to hey, we're paying him to work, but this is probably a like a well-known news anchor, I would assume, in the sports.
Speaker 3:Uh, yeah, I saw here like uh, I don't know if it's the, I don't know if he's the voice, but like there's a video game, madden, right.
Speaker 1:So I think it's kind of like that, but um, yeah, yeah, so I think his voice is definitely ai generated, but then for the rest there's not really much details available. Will the ai also kind of choose the highlights? Will it choose what to?
Speaker 1:say or is it just a script? Ai also kind of choose the highlights? Will it choose what to say? Or is it just a script? They have said so. The NBC says that they will review all the content, including the audio, to really assure that it's yeah, there's no hallucinations and it's accurate.
Speaker 2:Yeah, and I think for the let's say, the content, you can still very much do some quality check today.
Speaker 3:Just say if someone is interested in swimming, use this fragment, yeah yeah, yeah, but also even that you can have gen ai assisted stuff, right, so you still have the stuff. You can have a, because in the end you can just go from text to speech, so you can still have someone that generates the summary for swimming, someone that curates that and then that gets sent out to everyone that is interested in swimming. That could also be done, right I?
Speaker 2:would use it you would use it ideally with like a voice I can select which voice would you select part? I don't know, like mickey mouse, hi friends would you be willing to uh, to lend your voice to uh, to someone for you, for me, I would do a part oh wow, yeah, for you, I'll do it do it, bart. Oh wow, yeah, for you, I'll do it. We have an aww.
Speaker 3:No, we don't, we'll add it to the board to get you to recap uh, the olympics in the morning.
Speaker 2:It's like good morning part comes off.
Speaker 3:Yeah, I hope you slept well, so this is a good use case in your eyes, bart you. You approve this. Um in your iBARDS, you approve this. This Gen AI use case, I approve. What about Figma?
Speaker 2:What about Figma? Figma, now is this big redesign.
Speaker 3:Phil, you're setting me up for something I know, but before, before the setup is complete, I'll let Jonas also draw this up. So again, another topic from Jonas. So shout out to Jonas for being very well prepared, bring a lot of interesting topics. What topic from you? So shout out to yonas for being very well prepared, bring a lot of interesting topics. What is this one about? What is?
Speaker 1:uh, maybe for the people that don't know what is figma and what is the redesign with ai that they have done. Yeah, so figma is a tool that you can use to quickly get mock-ups. So basically, if somebody's going to design an application, they're not going to code the application from scratch, already functional. What they'll first do is they'll make a design in, for example, figma that's non-functional, but then they can already fine-tune where they're going to place the buttons and design the user experience in that way. And now they added an additional new functionality where with gen ai, you can basically prompt to get started quickly. So you can prompt, kind of saying I want an application that does this and this and this, and then Figma will already generate for you a first project to get started from.
Speaker 3:So it's really from text. It will create a Figma design. Yeah, I wonder if that's faster than just kind of doing it.
Speaker 1:I think to get started, like for example here what you just shown you can see that with just a couple of touches you already get some images in there. They're already sized, um. So I think it's it's probably nice to get started really quickly and then you can take over and do whatever you want with it so I feel like you could apply the same approach for, like, powerpoint slides.
Speaker 3:I guess, right, like a US co-pilot creates some slides about the meeting we had last week, it will create a first draft and then I can kind of go and fine tune and do this. And that I guess the reason I'm thinking like if it's easier, because, like with Dolly a while ago, when I was trying to, I had to prompt so many times oh, yeah, do this, okay, do this in this style, okay, do this in this style. But put this thing there. And I'm like man, I think it would be nice if I just try to like sketch something out and then ask you to iterate on but here they are not really making this.
Speaker 2:This is not really image generation, so. So I'm not sure how figma will do this, but canva, for example, which is somewhat compatible to fig or already does this and, like you, have different elements. So you have text, you have images, you have videos and and like it. Basically, the ai part is that it makes a selection of those things that fit well together and and with some uh, with some starter, uh, images or text or these type of things, so that you have a first layout of what you want to have and that you can then start building upon instead of starting from scratch.
Speaker 3:I see this um and then do you this, this a good use case for your part um, I really see it as a tool.
Speaker 2:In my opinion, like, to me, this is this is, uh, like a template gallery on steroids. Like a template gallery is valuable because it gives you ids, although I should just start only from blank slate. Sometimes it's helpful to look at things and to get started quickly, but a template gallery is only as big as this. Um, this like makes your template gallery like dynamic. Like, yeah, I want to see this with that, in combination with that, and give me some ideas with a with a yellow background, like much more and much more, let's say, prompt, prompt based template gallery. And that's I do like. Yeah, that I do like.
Speaker 3:Okay do you use figma, jonas?
Speaker 3:no, no, not at all um for me it's a bit um, it feels a bit I can. I mean, I can probably put very sophisticated things on figma, but then, like, when you give to like a front front-end developer, like do this now, it's probably like man, this is like, it feels like the. The jump from like a figma design to actually working up is probably huge. You do you mean? Because I feel like sometimes I don't know, like I don't, I'm not a front-end developer, right, but like I have seen people say, oh yeah, why don't you just do this? And I was like well, man, this is gonna take a lot of work, oh yeah, but if you just do this and the moon becomes a sun and the thing jumps and you can do this, oh yeah, just just do that.
Speaker 2:And I'm like man, this is like super complicated, all right but I think the key to this is that you should not make the figma design yeah, but you are ux designer should make the figma design but to me it's just like yeah, I think it's, it's, it's.
Speaker 3:I think it's cool that there's like something that you can visualize and do all these things. But to me, like I don't know, it's a bit weird. Like I feel like there's so many tools, there's so much support for just kind of doing mock-ups, but I feel like the, the, the bulk of the work, the thing that really constrains or the thing that, like, if the ui is bad, I don't think it's because there was a bad design originally. I think it's more because whoever was implementing it, maybe they had to adapt some things, or maybe the ui got clunky because of this, or maybe you know uh, but you're a bit questioning the value of something like figma.
Speaker 2:That don't. I don't agree with that questioning no, I don't think it's not. Not the value of figma I think you don't need it. When you're one designer that does front on the back end and you know ever clearly in mind like how you it to look like from the moment that you're a team. Let's say we're a team and I'm going to ask you let's build a to-do list and you all have some front-end skills. You're all going to build something completely different.
Speaker 2:But it's like Right, and you need someone that actually makes a design that you can then implement.
Speaker 3:No, I agree with the value. I guess I just feel like you have a whole tool just for that. It feels like you've invested a lot of money in something that like, how much of a difference is that for me? Just kind of drawing something on paper and then putting some color codes or something that I just give it to you?
Speaker 2:But you don't need VS Code on either right as a developer, like you can just put it in a text editor or not.
Speaker 3:Yeah, but I do feel like again. For me it's like the, the tooling to support the actual front-end development needs more support than the ux developer for figma.
Speaker 2:See what I'm saying um, I think you're no at a risk to get cancelled I just feel like it's like I see so many many stuff.
Speaker 3:You have AI Now you have all these things and to me I'm like I feel like there are tougher problems to make this happen.
Speaker 1:Sometimes designing this UX is also not easy. And then they they want you really to be able to do a certain action in two clicks, not in three clicks, and then there are 10 of these actions that have to be very well supported. So then it becomes really how do we fine tune the UI such that this is very easy, but you can still find this there and this there? I think there's a lot of these kinds of questions that we don't think about because we've never done this kind of design.
Speaker 3:I mean there's definitely a bias, because I've never done these things.
Speaker 2:Let's make the parallel with visual design. Let's say why do you need Illustrator to make a flyer? Why do you need AI in Illustrator to make a flyer? It's just a flyer, Like it's nothing, no interaction with it.
Speaker 3:But that's the end goal, that's the end product.
Speaker 2:So if it's the end product, then it's fine, but if afterwards you still need to do something, then it's not okay.
Speaker 3:But to me it's like maybe to say, oh yeah, I just maybe I don't know, maybe it's a silly example I want to put a search bar here in this. Just do that, and it's something. Just like it takes maybe I don't know, I'd never use this, huh, so just take with a lot of salt, but like, maybe it's like a few clicks on figma, but then it's like for like that takes a month work for the developer that is here. Just agree to disagree okay, I'm okay with that. I'm okay with that.
Speaker 1:I'm okay with this um, maybe one more thing I would like to touch upon is and I don't know if this is possible, but what I would really would be really cool if the ai can really understand the design. It can also help you generate ideas based on design you already did like, for example, like ah, I don't really like this design. I would like to show all of these elements at the same time, but still focus on this one. Can you generate some ideas or can you generate some options for this?
Speaker 3:yeah, I think as a brainstorming I think it's I mean, ai in general is like a brainstorming tool.
Speaker 2:I think it's actually quite nice so, for example, in mid journey, you can more or less do this. You can say, okay, I have this thing, use this now as a style reference. So we, we fix this, but now we're going to create something else with it. But what I'm also interested in Figma. So we're just talking about like the mock-up of a single page, for example, but what you can actually do in Figma is that you have more or less you simulate the whole working of the application. So you click a button, you actually go to the mock-up of that different screen. So it would be interesting to see I don't expect them to do that now, but to also see there some like can they generate a full part of the user interaction there? That would be interesting.
Speaker 3:I think it'll be interesting, I guess. Now I'm trying to think how to organize my thoughts part Rehashing that conversation, reopening that box.
Speaker 2:Afraid to get canceled.
Speaker 3:I have no fears, I got your back. Ui UX designer I got your back. We won UX designers. No, I guess it's just like. I guess I have a. I guess it creates the impression that it's really easy to do the front end right Like oh yeah, you do this in Figma, you click here, you open this page. That's pretty much what the app needs to do, right, so it's easy.
Speaker 2:All the rest is just code. It's easy part code but is it? It's just JNI, right it's co-pilot.
Speaker 3:I feel like there's no point in that. It's a losing battle. Let's just move on, I think both things are equally difficult you think?
Speaker 3:yes, both things are skills on their own no, I agree, but I guess it's just like I guess I still have. I guess it's just like. I guess I still have this feeling, a bit that like because something's easy to do in Figma and something that would be very complicated in a front-end coding, that the fact that Figma makes it so easy, it kind of gives the impression that it's easy to do an actual the front end code right. Oh yeah, I just clicked here. It's like this Just do that, just do that. Well, how hard is it? But like, yeah, there's actually a lot of stuff you need to know before you can actually implement this, like maybe on a web app, right, with the windows and the scaling and all these things do before you're a decent designer as well.
Speaker 2:true, it's not easy yeah, I think yeah and you're just making it look like I'm gonna type in some code now and then I have the design. But you actually need to have a full analysis with the user to understand, like what is, what is the functionality direction you're building? What is the experience that we want to give the give the user that? What is the logic that is behind it, with the different views that we need to like.
Speaker 3:I mean, it's a complex process no, but that I that I agree like in terms of not that because something is not code and it's not complex it's very smooth, but he's like slits and things in there.
Speaker 3:I never said that for the record. I I don't believe that at all. Um, but I do agree, like the, the actual user experience, how users grow from one screen to another. Where is the retention? Where do people drop off all these things? It is a science in itself that I agree. My point was not about that at all, ux designers. I'll just leave it at that, because I see it's the longer I continue the conversation with Bart, the higher likelihood that I will actually get canceled. What else got canceled?
Speaker 1:r1 maybe I know this. Bart says it's a old topic, but I think we haven't. We haven't circled back. New things keep coming up. This is basically what?
Speaker 3:what has come up about the r1 rabbit r1. So maybe recap as well.
Speaker 1:What is a rubber I won for the people that missed the previous episode so rabbit r1 is this little orange device with a small touchscreen uh, a camera, and basically the main functionality is it's an ai assistant, so you can ask it things by speaking to it and it will answer with ai generated answers. There's a few other things, like you can use the camera to ask what you see and these kind of things. The main thing is, when they it, they were hyping it up quite a lot, they were promising a lot of things and then when it actually arrived and people reviewed it, they were very, very disappointed.
Speaker 3:I almost bought one. You did. No, I didn't, but I almost did.
Speaker 1:I'm sorry I didn't you did, no, I didn't, but I almost did, so I didn't, yeah, and so what happened now is there's this group of hackers, let's say between uh quotes named rabbit dude, and this is their page.
Speaker 3:Yeah, super cute logo. Actually it's like I mean not cute, but uh, it's a very app type view yeah, yeah, and they're actually devoted to jailbreaking this rabbit r1, and so these people.
Speaker 1:They actually found hard-coded api keys in some code we don't really know which code, but this basically gave them access to 11 labs. So that is the service that they use for text-to-speech azure there was some old text-to-speech thing and also yelp and google maps, and this, of course, a big security breach, especially for 11 Labs, because there you can read every response that the R1 has ever given. So if you thought that information was private, these people could read it. Moreover, they could change the voices and also delete them. So delete the voice that the Rabbit R1 was using, and they claim that if they would have done that, the whole OS backend would crash and all of these devices would be useless so these api tokens that they found in the source codes, they were not scoped to this device.
Speaker 2:It was. It was. Yeah, it's a global scope, jesus.
Speaker 3:Fuck yeah, that's painful and also there's the whole thing that they mentioned, the rabbit r1. They had the large action models. That was not a llm was a large action model, but it feels like tomato, potato, right, like it's the same but I think this, like I think they got a lot of flack because it was underwhelming, I think a lot.
Speaker 2:There's a lot of kerfuffle as well. That I think is a bit uh over reach, but I think this is a big problem. Like there's a huge security kerfuffle as well. That I think is a bit uh overreach, but I think this is a big problem.
Speaker 3:Like there's a huge security flaw, like this type of thing yeah, it's huge the other thing that we were discussing a bit is like the human ai pin and all these things like, yeah, like this, because this is a full device, right, like, like you mentioned, it's like the orange thing has a different button, it has a, it has a touch screen, but apparently you couldn't use the touch screen to do a lot, uh, even typing and stuff like that you get these discussions like oh yeah, but it's just an android app, like these type of things.
Speaker 2:But to me it's a bit of a it's. It's a bit of a non-discussion in a sense that, like we're, we are trying out new modalities to see if this is odds value. I mean you can say the same thing. I don't need a phone because you can do the same thing with my, with my laptop, right, I mean we're not having this discussion, but because we tried it out and we see the phone is valuable like you're never gonna get anywhere else.
Speaker 3:If you say it can be done on a phone, yeah, you can do a lot of things on the phone but yeah, just so, maybe, to like yeah, you mentioned as well, and you also brought this, that indeed, rabbitr1, it is confirmed that, like it is just Android under the hood, right, like actually you can install in a Google Pixel, right, so you actually see here, like people following the live stream, there is a phone with actually the screen of the RabbitR1, right, so it really just is. It all the way down is just an Android thing, right, and I agree, bart. But at the same time, I also feel like the way that it was marketed. It wasn't like that. Like they did kind of promise a new type of device that was rethought for accommodating the large language models, because this and this, like they didn't advertise this as like this is a phone.
Speaker 3:Well, maybe they hyped it up too much, that's what I'm saying because I feel like I agree with you and I agree like, yeah, some phones have touchscreens, some phones maybe most phones today have touchscreens, maybe some don't, and like, yeah, you can discuss the different design, but we don't have this discussion because they still all say that their phones and I think for the rabbit r1 they weren't, they weren't looking at it like, oh, it's a phone. No, this is an innovative, groundbreaking, uh, personal assistant device with large action models that are you know, and it's like, yeah, okay, not really. Yeah, it's just, just just the same model.
Speaker 2:Like you, but is it? I mean like it's different, different, there's a different form factor, like if it would do everything as fluently as it, as it was promised. No one would be worried that it's an android app, true, like if it would function as well as that they hyped it up with. Like no one would would worry that there is android hunting under the hood no, that I agree but I still feel like we're only bashing, because they're not living up to what they actually promise in terms of functionality yeah, but I also think you can do the same thing on your troop.
Speaker 3:That's not really the point I also feel like there's a bit of the uh. It's not just that, I feel. I also think there is a the innovative promises right. Like they didn't say like they did. I don't know. It's like I don't think you would get as much attention, but I do think that it would be disappointing. You know, when you say I have this new device, I have this new thing, and then it's like, okay, no, it's actually just running the same thing, like the models are actually not new models and all these things. So if I promise that something's going to be super groundbreaking and it's not, I also feel like that does play a role. Yeah, but I don't think it would be as much. That is a problem here. Like they hyped it up too much.
Speaker 4:Yeah.
Speaker 2:They promised too much. Indeed indeed, indeed, I think that is a major well now, together with security issues. Yeah, yeah, yeah.
Speaker 3:But I even think, like one thing that they mentioned is like yeah, the Revit R1, they do have a touchscreen, but they chose not to use it because, if they did, it would look too much like a phone To me. You're making things more complicated, I think what works for these things is a UX designer? Is my AirPods, your AirPods?
Speaker 2:For the functionality. If they would actually be able to deliver the functionality that they promised in terms of interactivity, what you could do with it. Like I'm already using my AirPods, right. And there's also like don't need to explain to anyone. Like why are you wearing a weird device? Like like this is common you just don't.
Speaker 3:You just don't want to get weird looks on the street part. That's what you're saying. Uh, all right.
Speaker 1:Um, yeah, you have something yeah, but it's, it's exactly this uh, these large action models is like another thing. They were saying we reinvented a new model. It actually, yeah, really takes actions in the real world on your apps and these kind of things we never saw. There's this whole CoffeeZilla video about it and it claims to have seen the source code and these kind of things, but it doesn't seem to be there in the functionality at least.
Speaker 1:So it's just a bit overhyped underdelivered, and this is where a lot of the backlash is coming from, I think.
Speaker 3:Yeah, then I think there's also a lot of people that bring up that, the same company. They had a lot of promise on NFTs.
Speaker 1:I want to say yeah, yeah, the same company.
Speaker 2:they they renamed, but they had a very ambitious nft project, like there were quite a lot of them.
Speaker 3:And again, surprise, surprise all the crypto Bros do AI, now the programmers. Yeah, indeed, I mean, but I think, yeah, this is another example.
Speaker 3:Yeah, if this was a success, no one will be bringing up the nft story that's true, I agree with you but I think it's like, yeah, I think because it was such a big failure, but I still like I do think it was a. There were smaller failures that maybe would overlook if this was success, but this was also a failure, right, like the fact that you don't have actually a large action model, the fact that this is really just an android application, the fact that this and that right, but I think because nothing really delivered its promise, there's nothing really that innovative. But I remember even seeing like people saying, oh no, this is the Steve Jobs. Steve Jobs like analogous to the Steve Jobs keynote for Apple and all these things, and I'm like, whew, yeah, maybe I have a. We have a comment here. Let's see from Jonas Jonas, jonas Williams, knowing that there are scraper bots looking for exposed API keys doesn't surprise me. It could have been an app on a smartphone to begin with. Didn't see the added value of having yet another device.
Speaker 2:Indeed, I think we all agree.
Speaker 3:I think we all agree. I think we all agree, indeed. All righty, maybe are we okay to move on to the next topic. I also see the time a bit. Maybe it's time to go to the tech corner, because a wise man once told me that a library a week keeps the mind at peak. Have you heard that, bart? Yes, I think we have a badum.
Speaker 2:yeah, I'm not sure on the button.
Speaker 3:It's called punch, you know, I think so, whoa, we do have it nice, nice um, what do we have?
Speaker 1:what is this pie instrument thing that you uh, what is it about units? So, as I said, I'm a listener of the podcast and some really cool things came up in this. Uh, library week keeps the mind that big well, some, a lot, all of the things.
Speaker 3:What do you mean?
Speaker 1:but I was like what are the chances I'm actually going?
Speaker 2:to use these?
Speaker 1:that's a good question, yeah and so I wanted to bring up something really, really simple that every python developer, I think, could use yes, we're talking to you python developers it's called by instrument and it's just a really really easy way to profile your python code. So when you're doing python you often don't really care a lot about performance. You just want to have an easy developer experience. But still, even in python it's very easy to do something small wrong which kills your performance completely.
Speaker 3:So maybe for the people that never heard about profiling code, you basically mean to take a piece of code and see where the program spends the most time on.
Speaker 1:Yeah, exactly, and so all PyInstrument needs is you just write with your profiler as your profiler, you indent all of the code you want to investigate and in the end you say profilerdisplay or profiler open in browser and you get your profile.
Speaker 3:Ah, so it's actually in the Python code, it's not on the terminal.
Speaker 1:Yeah, yeah, yeah, that's the easiest way to use it. It's just in your Python code, or in your notebook, or wherever you're using Python. I see, I see python code or in your notebook or wherever you're using python. I see, you see, ah, but there's also cli option here next, if you want, you can do it in the cli as well.
Speaker 3:Interesting, ah, I see here. Yeah, so this is like uh interesting, very cool. I have used um the profiler with the pytest, so there's a pytest plugin, but I don't think I think they use the cpy c profiler or something yeah, yeah, there's a multiple ones of these to profile python code.
Speaker 1:Why did I pick this one? Because it's just so easy to use.
Speaker 3:Yeah, that's very cool. Very cool, do you profile your python code a lot?
Speaker 1:uh, yeah, sometimes if I see if I will have to process a lot of data with my uh python code, it makes sense to just take a look and I found really simple things to fix just because I wasn't paying too much attention while implementing.
Speaker 3:Very cool. What about you, Bart? Is this something you?
Speaker 2:I quickly looked at the documentation. It looks very intuitive. Never use it myself. Typically when I'm in a situation that I'm profiling code, it's in a bit of a bigger setup and then you typically have profilers that are linked to a monitoring tool like New Relic or Datadog, which have their own profiling plugins. Interesting Because it does have a little bit of impact on your like. If you look at the docs, it does have a little bit of impact on your code because you need to make it like, for example, example, if you want to profile a flask application, you need to import by instrument and add a little bit of code. Um, so it's not independent like you can't just switch it around and then use another type monitoring tool on top this is cool and uh, I think for for small, for small projects, very, very helpful indeed.
Speaker 2:I think for small projects it's very helpful indeed, I think. For example, now I have a small application that I made the other day I actually told you about it which is a bit of a proof of concept, and the API calls take a long time and if I would use this profiler that very much, very quickly becomes clear that because of the storage backend. But from the now the code is very easy and I made it myself and I know why it is. But if I would just get this from somebody and I don't know the full context, I would use something like this and then because of this, I immediately get clear okay, it's a lot, a lot of the time, it is actually uh being in the taking for to get the storage back into um.
Speaker 2:So I think for those that are like also, from the moment that you get uh started in a new project, you need to learn what is there like. I think these things could be valuable yeah, indeed, no, I agree.
Speaker 3:I also think it's a good, uh, very concrete argument, for someone says my application is low and it's like is this something that I can do, or is this something that like, yeah, there are some things we can do, but indeed, it's hanging on the database, it's hanging on the ios, hanging on something else, right, I think it's very good, very good insights there as well, so pretty cool. Haven't tried it, but I will try next time. I'll keep it in mind next time I need to use it. Um, maybe also to circle back on your comments. The idea is indeed to have something useful.
Speaker 3:Whether it is useful every week, I'm not sure, but, uh, I think that's uh it depends on the problem you're solving indeed, and maybe talking about something maybe not so useful, llama ttf very curious as to what this is yes, llama ttf, ttf. What does that sound like, bart, when you say dot ttf?
Speaker 2:ttf. Uh stands for true type font yes it's a.
Speaker 3:It's a font file exactly, it is a font file and llama uh, jonas it's a large language model.
Speaker 3:Yeah, indeed that's weird and weird combo, but indeed those two things are correct and those two things mean these things here. So llama ttf is a font file which also, which is also a large language model and an inference engine for that model. What, yeah, exactly, it's actually the language. Uh, what, uh, now, with def, is a font file which is also a large language model for an inference engine. Definitely a model. Why? How? Okay? So this also hurt my brain a little bit, but apparently there's something with the Wasm shaper that allows arbitrary code to be used on the shape text. The guy embedded weights from a Llamath model and an inference engine to query that model within a font. So maybe just before there's a little video and I'll skip forward.
Speaker 2:So explain to me just what functionality that brings.
Speaker 3:I'll show the video then. This is a video that um the creator I guess uh, well, again the.
Speaker 3:The link for the this page that I'm showing here is going to be there as well, and I'll show the video. Uh, basically in the video here the guy is selecting the font, so he's like a text file kind of thing. He selected different fonts. He's finding here Llamasans regular. I'm going to skip forward a bit. One thing that he does as well. It's like every O is actually the. It looks like the empty symbol, like the O with a cross in the middle. So one thing that he does. Again, it's not super useful, but he mentions here that if you type abracadabra maybe I can make this bigger if you type abracadabra before, let's see all the empty signs become. Uh, oh, so actually you fix. So this is like making a joke, like every time you type abracadabra the text fixes itself right. So you see here that it becomes once, but then if you change it, if you change it to abracadabra, the o's become empty symbols again.
Speaker 2:Yeah, hold on hold on. There's more, there's more, there's more just to understand like it's based on what you write, the font changes. Is that correct? There's more but and how does that work? Like is there a runtime in a font?
Speaker 3:there's a wasm shaper, I guess, so it's like a web assembly stuff exactly. I don't know how, how well this works, but this did pique my curiosity about what are fonts um so now I'm also wondering, like how does ttf yeah?
Speaker 3:And then he mentions like he said, the idea here is to write a children's story. But he said, yeah, but then we actually have to write the story, right? So usually children's stories started with once upon a time. And then he starts here and he starts putting exclamation marks Okay, and then he goes exclamation marks and then after a certain amount of it so he Joe, he's actually very humorous he says for a another limb to, for the computers to obey, you have to scream at it. So he just starts like keeps putting exclamation marks, like he's screaming, and then after some point the exclamation mark vanish and then every time he types an exclamation mark. From that point on, the lm is generating text. So I'll go a bit here. So the so like the text where people they're following says once upon a time there was a little blah blah so it can actually generate text not just change the font but,
Speaker 3:it's it made my brain hurt that. So he goes here and if you copy and paste the text in another place that has a different font, you actually get the original text, which are just exclamation marks, and he also shows. So he's in the video. He's are just exclamation marks and he also shows. So he's in the video. He's putting his terminal, but he can also show that if you change the font back on the editor, you get the original text, which is just exclamation marks. So he's actually prompting the LLM to generate output based on the text that he put. But the text that he actually wrote is now what's displayed on the text having a hard time understanding how this works I mean, I don't either, but the fact that it works, it's super, like what the fuck?
Speaker 1:yeah, I think it's basically what he has in this ttf. The ttf file is basically he takes the text that it's been typed as input and then he has a little rendering engine that decides what is being rendered on screen exactly, that's usually it's character by character. But it makes me wonder how this exactly?
Speaker 2:works within a ttf file, because it means that from the moment that you use it, there's this rendering engine in the background that you can character by character. But it makes me wonder how this exactly works within a TTF file, because it means that from the moment that you use it, there's this rendering engine in the background that you can.
Speaker 1:Yeah, I think it's mentioned here that you can run arbitrary code that decides what to do here.
Speaker 2:That seems like a security risk.
Speaker 1:Yeah, but I think that's probably. If you want to install fonts on your windows machine, you need admin rights, that's true that's true.
Speaker 2:Yeah, indeed, so um this is this.
Speaker 3:Uh makes fonts even more interesting I know right, that's probably not what you thought when you I maybe don't even need python, no more, like I just make fonts yeah, exactly right.
Speaker 3:Like actually there was something that he said like you can use your font to talk to. You know, this also means that you can use your font to chat with your font. Mind blown, wow. Um. And then he even points here like everything was completely so. Um, your favorite text, email, whatever, blah blah, and everything runs completely locally. So perhaps the silly hack is in fact a million million billion dollar idea. Right so everything is running locally, and this and this, and you also have an engine that runs this built in, right so?
Speaker 2:you can have this hidden alarm somewhere.
Speaker 3:Exactly, or like you want to just pretend you're working. You know. You just keep pressing the space bar and code appears. You know, pretend you're working, you know. You just keep pressing the space bar and this code appears on your. You know, it's just all right. The title of the video is also using llama ttf to eradicate writer's block, so it's a bit of a. It's a humorous, um interesting. I also thought it was funny.
Speaker 3:I'm gonna read up on the the tttf file format right, but I also got like way more curious about it and also wasm in general. Right, I think there's a. I was listening to another podcast that they were saying that wasm is the. What is it like? Wasm is the new kubernetes. They were saying it was a very far-fetched analogy, but it's just like you can use, you can compile things to wasm and then you can just ship it in most places and scales and all these things. So. So also made me curious about it. But I'm not going to lie, this demo did make my brain hurt a bit. Don't fully raise more questions than it answers, but nonetheless pretty cool.
Speaker 2:Alrighty, I think we have time, just for maybe one hot take. Do we have a hot take?
Speaker 3:yeah, maybe a soft hot take.
Speaker 4:I'm not sure how hot it is oh, hot, hot, hot, hot, hot, hot, hot, hot, hot hot nice.
Speaker 3:this is something that I it's actually not super new, but it's actually from a Google leaked internal document. So basically, what Google is claiming is that OpenAI will not they don't have really in the long term. Open source models will catch up. Open source AI will outcompete Google and OpenAI in the long term. Basically, what they're saying is that the edge that OpenAI has today has more to do with compute and investment, but now that everyone knows that this is a viable direction, like this is super valuable. There is a race to catch up and in the long run, the head start that OpenAI had is not going to really hold in the long term. Like things are going to catch up. It's not a matter of like something like a know-how or an expertise that only OpenAI holds. Yeah, and I think what Google is trying to say here is like I'm not worried too much about it. I don't think this is part of our main product, because if it was, we would have an expiration date. Is this something you agree or disagree?
Speaker 1:I think I agree. For me, we've been scaling up just through compute and amount of data, and at some point there will be diminishing returns, I feel, and so that means that everyone that's a bit earlier on the curve will have a easier time to catch up. This is my feeling with this, unless we have some kind of another breakthrough, another way to scale, another way to get better performance. These kinds of insights could break that pattern. But as I see it now, this is what I think.
Speaker 3:Yeah, I think also with the rise of open source models as well. Yeah, like Facebook really is one model that is not as good as open AI, but it's already available for people to build on top of that. Arguably, the compute cost that you need to get to a LLAMA you don't need all that, you just need to build on top of that. Yeah, what do you think, mart?
Speaker 2:um, maybe to be if it was expected of me to be as good as open. I haven't been able to do so for a long time. I would also say that probably right, google, um, but uh. On a more serious note, I think that we have, until recently, we've not really seen any true competitors to OpenAI. Until very recently, I think, with Cloud 3.5 from Anthropic. We have, and it's still not completely up to par, but it is extremely close to the best that OpenAI has to offer. So I think the reality, if we today are that close, if we take this in the long term, years, there will be companies that catch up. I don't think just anyone, I don't think just if you're a bunch of developers and you start from an open source model, I don't think it's easy to catch up and you need a lot, a lot, a lot of resources to be able to do that. Only the, the major, major players or the people with major, major funding can do that do you think that, like in three years, do you think we'll have?
Speaker 3:because I'm also wondering in terms of training data, right, is there a lot of different? Is there a lot more training data that you can actually get?
Speaker 2:that will make a difference as well well, that's the challenge that we're trying to to solve now, right like we are flooding the internet with uh ai generated data and do you think that's a new? Training data. Will it work? Is it going to degrade the model? Is it?
Speaker 3:do you think that in three years we'll have just open eye ahead? Do you think we'll have like a, a group of models, let's say like mistral, anthropic, open ai, or do you think it would be like, oh, there's going to be a flood of open source models and all these things. How many years?
Speaker 2:is that.
Speaker 3:I'd say five years, Three years, then Five years. I think is a lot.
Speaker 2:I hope to have at least three.
Speaker 3:Three.
Speaker 2:That are up to the same level of performance.
Speaker 3:Open source or you think it's open source I?
Speaker 2:don't think it's realistic to have an open source model in three years that had the same performance. What do you think I mean? What is the? What is the incentive to, for anyone to fund that?
Speaker 3:well, meta may want to kick open eye in the legs right to just open source stuff uh, if they would actually open source, but it's not on an open source license. Yeah, true, like, but yeah, okay, maybe what if Apple Apple models, because also Apple absence, the, the the, the licensing and everyone's licensed with open AI now to get their uh Siri up and running.
Speaker 2:I don't think it's like. I think I hope that there will be at least three that are up to the same level of performance. I hope it will be. I mean, that would be good.
Speaker 3:But I don't see it happening within three years. Okay, what's your?
Speaker 1:uh, yeah, I also hope that there will be, uh, multiple players, of course, and I think something else we might see then is that, yeah, the models, or at least companies building those models, will try to differentiate more and more, and I think we might start seeing yeah, if I'm working in Copilot, I have no need for a general model, I can have a more specific model towards coding and it's going to be more clear like, ah, this model has this better capabilities than this model, and this model has that.
Speaker 2:And so they're going to try to differentiate and we're hopefully in that sense also gonna get different models there but then I agree with as well and the other thing is also in that time definitely realistic that you see niche models that in their own domain really outperform the general purpose ones. Yeah, and there I think also like the, that you do have some more with a bit more. You can also debate a bit more altruistic point of view where there is some incentive to subsidize this, for example, the Dutch GPT Roberta. No, it's a project that is subsidized by the Dutch government and they are trying to build something that is very performant on Dutch language, which hopefully will become a niche model, which is good enough, but it will never outperform in three years the general purpose ones.
Speaker 3:Yeah, I see what you're saying.
Speaker 2:But there is some incentive there to say like, for example, for our government it's okay, it's important for us that we have this, because it gives us some independence from others.
Speaker 3:Yeah, no, that I agree.
Speaker 2:I think there's not really an incentive to say let's put billions of dollars or euros on the table for a fully open source product, like who's going to sponsor that, like who has the these means to be, and is that the same as altruistic to say?
Speaker 3:but do you think you still need it If there are models that are not as good but like you have?
Speaker 2:well, but there's a different scenario that that's when that's our niche model, right well, but there's a different scenario that that's when that's our niche model, right, like we were discussing like the general purpose, ones that we see today the reason why I came up with this.
Speaker 3:Uh, I came across this article because we're also discussing a bit the the apple uh intelligence announcement. Right, how? Not gonna go too much in detail now, maybe next time you can dive a bit deeper. But they also mentioned that like, is this something that's core to the capability? But they also say like, yeah, if, if apple decides that they really need to invest all this money, maybe they could, I guess, because it's just about investing money to train a model, and maybe there will be someone else that would also say like, that will see the, the capabilities of OpenAI to build this in-house.
Speaker 3:Apple is not doing this today. Apple is actually offloading stuff to ChatGPT, according to the article as well. It's a bit of a marketing strategy, because Apple models will never suggest you to put glue on your pizza. The Google one did, because the apple models are not returning free text like this, like even siri. If you ask something, siri won't give you an answer. It would say, oh, I couldn't find anything. You want to use chachapiti to answer that question. So if you do get an answer on putting glue on your pizza, it's chachapiti's fault, it's not apple, right? So they kind of respect the reputation of this as well.
Speaker 3:But if apple, apple did want to invest on these things, and also like Apple, I think I remember reading that there were rumors that they were going to have multiple models right, like this, openai now, but maybe they'll have Gemini later, maybe this and this and this, that, like it just kind of becomes. It's not like Apple. Openai is the, but there's like a group and you can just kind of select. It's kind of like a commodity kind of thing, you know, and I think in that sense, that's where the Google memo kind of came across, kind of saying like, yeah, open AI is what I said today, but just give it a bit of time and other people are going to catch up and it's not going to be open. Ai is the one that we need to go. It's just going to be like yeah, there's a few that we can choose, and that's, I think, is to a certain extent realistic. Cool, anything else you want to discuss? Any shout outs you want to give?
Speaker 2:Maybe last thing that I find it's not really data related, but I find it interesting that this is happening. There is, in some circles, a well-known independent browser project which is called the Ladybird browser which has been part of the SerenityOS project for a long time, that recently split from the SerenityOS project to really be able to focus on a browser and that I think since yesterday, uh actually also uh made a bit of noise because uh, the I think the co-founder of github, if I'm not mistaken, has put funding behind it.
Speaker 2:Oh, really, oh, and I think it's a bit like I think the team that is there, the person that is building the browser I think it's andreas kling, I'm not sure on the name uh, together with the person that's now funding it and network that he brings um, like this actually makes a chance, which is huge, because we only have what three browser engines out there yeah, and I think I mean you can probably explain it better than I can, but like the difference between browser and browser engines, like you can still use chromium, which is the browser engine, and just put another ui on top of it, right?
Speaker 2:uh, I think it's called chrome kit, but uh, or, I'm not sure how the engine is exactly called, but, like also, chromium is just a skin on that engine. Yeah, chrome is a skin on an engine. Or uh, brave is just a skin on that engine yeah, I see this um, and you cannot some on top of that, but this is a full new browser engine how many what you mentioned?
Speaker 3:three, which is what are those you're trying to?
Speaker 2:this is not top of my knowledge, um, but, uh, this to build a browser engine is super complex because they're the specs are extremely complex. Uh, they're the spec. Uh, they're also very like it's a huge spec base and there's a huge, huge amount of legacy in the specs, so it's super complex to build these things. Um, but where andrea has already brought it like it's a the specs, so it's super complex to build these things. Um, but where andrea has already brought it like it's a functional browser, so there's actual like, also the background that he has off working on other browsers, like it's the, it's the right team to pull this off if they get to do it it's crazy yeah, rather than me if I see a html and I have to turn it into something visual, like from the figma design I'll just prompt figma to turn it into something visual, like from the Figma design.
Speaker 1:I'll just prompt Figma to do it.
Speaker 3:Here's the HTML just do it yeah, but it's cool. Yeah, but I heard that you gave up on Mozilla, bart that I'm not a Firefox user anymore.
Speaker 2:Yeah, did you hear that word here?
Speaker 3:from the. What's the name? From the for something's mouth? What's the thing? Is there something like from the devil's mouth? Now, what is it, alex from? Myself yeah from you.
Speaker 2:You told me yeah, I moved to to firefox for a while but then you came back I came back because it's um, I, I, uh, the friction is too much.
Speaker 2:Yeah, I'm sad to say that, but uh, I just need something that works. Now, like half of the plugins I'm used to in in chrome, they don't exist for firefox. Firefox also like slowly shrinking, so you have a lot of new um applications that don't build stuff for firefox anymore. And, um, yeah, and I really have myself for some stuff going back to chromium and it wasn't, yeah, and I, I, in the end I caved for the part of release resistance no, I'm just kidding, I did the same thing yeah me too you use chrome as well.
Speaker 1:Yeah, yeah, yeah, and motivated by some people ah, you really shouldn't, you really shouldn't try it, firefox. But a week later I was back, so yeah and all, all because of the same reason. It's all these small things like it's, it's nothing big or something that keeps me for chrome, but but also like, if there's you have an issue with the browser, oh, this is not working.
Speaker 3:On this, I feel like the first thing I would hear is like, oh, try to do it in chrome, try it it in Chrome. Chrome is like the default, like it's the most supported. I feel like everyone is like that. Yeah, I see what you're saying Support Ladybird. Do you use Ladybird? Have you used Ladybird?
Speaker 2:Tried it. Yeah, no, it's months ago now.
Speaker 3:Okay, maybe they did a Lama Ladybird, you know like, you know, like a large language model.
Speaker 2:We're all the fonts as renders, exactly Every time you type anything, it's completely different.
Speaker 1:You have no idea it was a project like that, a website where you just typed a web address and, instead of going to a real website, it was actually AI generated.
Speaker 3:So you went to an AI generated website. Oh wow, we was actually AI generated. So you went to the AI generated website. Oh, that's cool. Oh wow, we need to link that up as well. Let's try it, alrighty. Cool, cool, cool. Thanks a lot everyone. Thanks, bart, glad to have you back.
Speaker 1:Thanks, jonas, thanks for having me here as well. Thanks for listening everyone. Yeah, thanks for having me.
Speaker 3:Yes, see you all next week.
Speaker 1:You have taste in a way that's meaningful to software people.
Speaker 2:Hello, I'm Bill Gates. I would recommend TypeScript. Yeah, it writes a lot of code for me and usually it's slightly wrong.
Speaker 4:I'm reminded, incidentally of Rust here Rust, rust. This almost makes me happy that I didn't become a supermodel.
Speaker 1:Cooper and Netties. Well, I'm sorry guys, I don't know what's going on.
Speaker 3:Thank you for the opportunity to speak to you today about large neural networks. It's really an honor to be here.
Speaker 1:Rust, rust, rust. Data Topics. Welcome to the Data. Welcome to the Data Topics Podcast.
.png)
