# crawlPages

**Kind:** Function

**Source:** [`atloria-monorepo/libs/parser-core/src/utils/web-crawler.ts`](https://github.com/sherkety/atloria/blob/main/atloria-monorepo/libs/parser-core/src/utils/web-crawler.ts#L89)

Crawl multiple pages with concurrency control

## Signature

```ts
async function crawlPages(urls: string[], concurrency): Promise<CrawledPage[]>
```

## Parameters

| Name | Type |
|---|---|
| `urls` | `string[]` |
| `concurrency` | `any` |

**Returns:** `Promise<CrawledPage[]>`