Posts

Showing posts with the label ComparativeLLM

Can LLMs I dentify Korean Adverbs? (Part 3)

With round 1 and 2 done, I was in a rhythm. I had 300+ new vocab words in my Anki deck. It took some struggle, but I still got it done in the end. The previous year, I spent weeks formatting data and entering it into Anki. I wanted to do more. I had a list of adverbs that I didn’t include in the original list because I had already added them manually to Quizlet. I decided I was just going to export the list I had in Quizlet and import it into Anki. However, that would just give me the Korean word and English definition. It wouldn’t give me the sentences as hints. So a few days later after finishing round 2, I decided to start round 3. This time I took a different approach. Instead of making the LLM split the words into two tables. I deicided to have all the words in one list. I thought that maybe my prompt was not concise enough or maybe a little confusing. So I wrote a prompt and then asked Claude 3.7 Sonnet to refine my prompt. This follow...

Can LLMs Identify Korean Adverbs? (Part 2)

Where we left off in round one, I was struggling with both ChatGPT 4 and Google Gemini 2.0 Flash to get them to just process the list correctly. I gave up on ChatGPT 4 because I didn’t need that kind of stress in my life. I already had decent results from Claude 3.7 Sonnet. I say “decent” because I noticed that there were words in the non-adverb table that should have been in the adverb table. I decided to have Claude reprocess each list. In the first round, Claude said that 94 words were non-adverbs. I gave it the non-adverb list again and now 68 of those words are considered adverbs and 25 of them are non-adverbs. Claude labeled 250 words as adverbs. I gave it the adverb list again and only 205 were considered adverbs. After processing about 103 entries, the prompt stopped due to message constraints. I had to prompt it with “continue” to get it to finish. I still noticed words that should be considered adverbs in the non-adverb table. “Why are 유효하게, 저조하게, 부자연스럽게, and 천진난만하게, not cons...

Can LLMs Identify Korean Adverbs? (Part 1)

I love learning languages. This includes programming languages as well as human languages. When it comes to human languages, I’m not a polyglot yet, but I’m working on it. My current main target language is Korean. I’ve been learning it for an embarrassingly long time. I know that learning a language is a marathon and not a sprint, but in the last couple of years, I decided to get more serious about my studies and double down my efforts. Recently I increased my intake of comprehensible input by reading short stories. I know a lot of nouns and know most of the common verbs and descriptive verbs (adjectives). The words I noticed I trip over are adverbs. I only knew a handful of adverbs. Because I am a language resources hoarder, at some point I scoured the internet looking for a list of adverbs. I ended up with a large list of over 300 words. Slowly one by one I started adding the words to my Anki Deck. At the time I did it manually because I had to check in an online dictionary to make ...