Chunk - Token composition Root

Chunk - Token composition

Description:

This profile describes the structural composition of textual information in the form of chunks composed of other chunks or tokens. A token represents an atomic element of texts, such as words, subwords or characters, while chunks form a syntactically or semantically coherent unit within a sentence. Each token and chunk is also expressed as a string in this profile.

Description

Show Description Language
This profile describes the structural composition of textual information in the form of chunks composed of other chunks or tokens. A token represents an atomic element of texts, such as words, subwords or characters, while chunks form a syntactically or semantically coherent unit within a sentence. Each token and chunk is also expressed as a string in this profile. en

Identification

Start date: 2026-06-01

Project of belonging: SDHSS - Microprofiles

This profile is a root profile. Find all its versions in the Versions tab.

Labels

Label Language Last updated
Chunk - Token composition * en 2026-06-01

* : Standard label for this language

Versions

Chunk - Token composition is a root profile.

Ongoing version: Chunk - Token composition ongoing

Other versions

Profile Version Status Publication date