tokenisieren
Translation
to tokenize
Examples
Der Algorithmus tokenisiert den Text.
The algorithm tokenizes the text.
Wir tokenisieren diesen digitalen Vermögenswert.
We are tokenizing this digital asset.
Grammar Patterns
((sth.)) to tokenize sth. The software can tokenize sentences.
Similar Words
digitalisieren (to digitize), segmentieren (to segment)
Etymology
From English 'token' + the German verb suffix '-isieren', commonly used to form verbs from foreign words.
Memory Tips
Think of breaking something down into small 'tokens' or pieces, like game tokens. Used in IT (text processing) and finance (assets).