> This means that it’s always on time
replyTell that to Deutch Bahn.
you forgot rule two, should have been "tell that to DB"
replySomewhat hilariously, our model is actually surprisingly bad at telling jokes in German. Guess that's not required to solve tasks in training environments.
replyDisclaimer: I am part of the team that trained Kolibri
Does it? I thought only semantics survive the embedding process, i.e. token conversion to vectors.
replyYou forgot to that it needs to create a DIN norm for any new technical creations.
replyIt is a good approach to promote it as a German model. But I wonder if it really thinks like the German think. I speculate they just translated texts in other languages, likely English and Chinese, into German.
replyHey, I worked on pre-training data Kolibri. We spent considerable time and effort to go beyond just translating. For example by building a pipeline that processes Common Crawl dumps specifically for German. You might be interested in a related blog post: https://aleph-alpha.com/en/blog/sauerkraut-not-burgers-why-g...
replyWe also talk more about German pre-training data in the tech report: https://aleph-alpha.com/downloads/tech-report.pdf section 2.3.2.2.
Read TFA. They were very aware of the dangers of such an approach. So they avoided it to the extent possible.
replyDo we get the same kind of jokes with other nationalities too?
replyOnly the funny ones
replyWe can joke with every country, except one maybe.
replyPeople from Mauritania are famously prickly, yes.
reply"It's a German joke, it doesn't have to be funny"
replyStereotypes. I suspect that what that means is that the reasoning chain is based on the German language and have its idiosyncrasies.
replyI think it means that German speakers can learn the thinking without speaking English.
replySorry, read*, not learn
replyStereotype accuracy is one of the few social science results that replicates.
replySomeday, it will break out via fax.
replyAnd it's always waiting for the verb to arrive.
replyI wonder if their very long words result in more or less token usage.
replyVery long words in German are just compounds, made from individual words or morphemes. It is the same as in English if you remove spaces. Subtokens will be equivalent with or without examples.
replyThis is an interesting question, Chinese is way more compact in Character count vs English (about 40%?), let alone german, but yeah.. Chinese makes up for it with… total character count that runs into the thousands…
replyAnd refuse to answer in English. You know, German are so proud of their language.
replyThat would be the French. Germans will answer in English, if they notice any hint of an accent.
reply