# tokenize

**Kind:** Function

**Source:** [`atloria-monorepo/apps/api/src/technical-docs/search-index.ts`](https://github.com/sherkety/atloria/blob/main/atloria-monorepo/apps/api/src/technical-docs/search-index.ts#L125)

Lowercased, deduped, stopword-filtered significant tokens (capped).

## Signature

```ts
function tokenize(text: string): string[]
```

## Parameters

| Name | Type |
|---|---|
| `text` | `string` |

**Returns:** `string[]`