{py:mod}archivebox.misc.util

:allowtitles:

Module Contents

Classes

:class: autosummary longtable
:align: left

* - {py:obj}`ExtendedEncoder <archivebox.misc.util.ExtendedEncoder>`
  - ```{autodoc2-docstring} archivebox.misc.util.ExtendedEncoder
    :summary:
    ```

Functions

:class: autosummary longtable
:align: left

* - {py:obj}`parens_are_matched <archivebox.misc.util.parens_are_matched>`
  - ```{autodoc2-docstring} archivebox.misc.util.parens_are_matched
    :summary:
    ```
* - {py:obj}`fix_url_from_markdown <archivebox.misc.util.fix_url_from_markdown>`
  - ```{autodoc2-docstring} archivebox.misc.util.fix_url_from_markdown
    :summary:
    ```
* - {py:obj}`find_all_urls <archivebox.misc.util.find_all_urls>`
  - ```{autodoc2-docstring} archivebox.misc.util.find_all_urls
    :summary:
    ```
* - {py:obj}`is_static_file <archivebox.misc.util.is_static_file>`
  - ```{autodoc2-docstring} archivebox.misc.util.is_static_file
    :summary:
    ```
* - {py:obj}`enforce_types <archivebox.misc.util.enforce_types>`
  - ```{autodoc2-docstring} archivebox.misc.util.enforce_types
    :summary:
    ```
* - {py:obj}`docstring <archivebox.misc.util.docstring>`
  - ```{autodoc2-docstring} archivebox.misc.util.docstring
    :summary:
    ```
* - {py:obj}`str_between <archivebox.misc.util.str_between>`
  - ```{autodoc2-docstring} archivebox.misc.util.str_between
    :summary:
    ```
* - {py:obj}`parse_date <archivebox.misc.util.parse_date>`
  - ```{autodoc2-docstring} archivebox.misc.util.parse_date
    :summary:
    ```
* - {py:obj}`download_url <archivebox.misc.util.download_url>`
  - ```{autodoc2-docstring} archivebox.misc.util.download_url
    :summary:
    ```
* - {py:obj}`get_headers <archivebox.misc.util.get_headers>`
  - ```{autodoc2-docstring} archivebox.misc.util.get_headers
    :summary:
    ```
* - {py:obj}`ansi_to_html <archivebox.misc.util.ansi_to_html>`
  - ```{autodoc2-docstring} archivebox.misc.util.ansi_to_html
    :summary:
    ```
* - {py:obj}`dedupe <archivebox.misc.util.dedupe>`
  - ```{autodoc2-docstring} archivebox.misc.util.dedupe
    :summary:
    ```

Data

:class: autosummary longtable
:align: left

* - {py:obj}`scheme <archivebox.misc.util.scheme>`
  - ```{autodoc2-docstring} archivebox.misc.util.scheme
    :summary:
    ```
* - {py:obj}`without_scheme <archivebox.misc.util.without_scheme>`
  - ```{autodoc2-docstring} archivebox.misc.util.without_scheme
    :summary:
    ```
* - {py:obj}`without_query <archivebox.misc.util.without_query>`
  - ```{autodoc2-docstring} archivebox.misc.util.without_query
    :summary:
    ```
* - {py:obj}`without_fragment <archivebox.misc.util.without_fragment>`
  - ```{autodoc2-docstring} archivebox.misc.util.without_fragment
    :summary:
    ```
* - {py:obj}`without_path <archivebox.misc.util.without_path>`
  - ```{autodoc2-docstring} archivebox.misc.util.without_path
    :summary:
    ```
* - {py:obj}`path <archivebox.misc.util.path>`
  - ```{autodoc2-docstring} archivebox.misc.util.path
    :summary:
    ```
* - {py:obj}`basename <archivebox.misc.util.basename>`
  - ```{autodoc2-docstring} archivebox.misc.util.basename
    :summary:
    ```
* - {py:obj}`domain <archivebox.misc.util.domain>`
  - ```{autodoc2-docstring} archivebox.misc.util.domain
    :summary:
    ```
* - {py:obj}`query <archivebox.misc.util.query>`
  - ```{autodoc2-docstring} archivebox.misc.util.query
    :summary:
    ```
* - {py:obj}`fragment <archivebox.misc.util.fragment>`
  - ```{autodoc2-docstring} archivebox.misc.util.fragment
    :summary:
    ```
* - {py:obj}`extension <archivebox.misc.util.extension>`
  - ```{autodoc2-docstring} archivebox.misc.util.extension
    :summary:
    ```
* - {py:obj}`base_url <archivebox.misc.util.base_url>`
  - ```{autodoc2-docstring} archivebox.misc.util.base_url
    :summary:
    ```
* - {py:obj}`without_www <archivebox.misc.util.without_www>`
  - ```{autodoc2-docstring} archivebox.misc.util.without_www
    :summary:
    ```
* - {py:obj}`without_trailing_slash <archivebox.misc.util.without_trailing_slash>`
  - ```{autodoc2-docstring} archivebox.misc.util.without_trailing_slash
    :summary:
    ```
* - {py:obj}`hashurl <archivebox.misc.util.hashurl>`
  - ```{autodoc2-docstring} archivebox.misc.util.hashurl
    :summary:
    ```
* - {py:obj}`urlencode <archivebox.misc.util.urlencode>`
  - ```{autodoc2-docstring} archivebox.misc.util.urlencode
    :summary:
    ```
* - {py:obj}`urldecode <archivebox.misc.util.urldecode>`
  - ```{autodoc2-docstring} archivebox.misc.util.urldecode
    :summary:
    ```
* - {py:obj}`htmlencode <archivebox.misc.util.htmlencode>`
  - ```{autodoc2-docstring} archivebox.misc.util.htmlencode
    :summary:
    ```
* - {py:obj}`htmldecode <archivebox.misc.util.htmldecode>`
  - ```{autodoc2-docstring} archivebox.misc.util.htmldecode
    :summary:
    ```
* - {py:obj}`short_ts <archivebox.misc.util.short_ts>`
  - ```{autodoc2-docstring} archivebox.misc.util.short_ts
    :summary:
    ```
* - {py:obj}`ts_to_date_str <archivebox.misc.util.ts_to_date_str>`
  - ```{autodoc2-docstring} archivebox.misc.util.ts_to_date_str
    :summary:
    ```
* - {py:obj}`ts_to_iso <archivebox.misc.util.ts_to_iso>`
  - ```{autodoc2-docstring} archivebox.misc.util.ts_to_iso
    :summary:
    ```
* - {py:obj}`COLOR_REGEX <archivebox.misc.util.COLOR_REGEX>`
  - ```{autodoc2-docstring} archivebox.misc.util.COLOR_REGEX
    :summary:
    ```
* - {py:obj}`URL_REGEX <archivebox.misc.util.URL_REGEX>`
  - ```{autodoc2-docstring} archivebox.misc.util.URL_REGEX
    :summary:
    ```
* - {py:obj}`URL_REGEX_TESTS <archivebox.misc.util.URL_REGEX_TESTS>`
  - ```{autodoc2-docstring} archivebox.misc.util.URL_REGEX_TESTS
    :summary:
    ```
* - {py:obj}`_test_url_strs <archivebox.misc.util._test_url_strs>`
  - ```{autodoc2-docstring} archivebox.misc.util._test_url_strs
    :summary:
    ```

API

:canonical: archivebox.misc.util.scheme
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.scheme
```

:canonical: archivebox.misc.util.without_scheme
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.without_scheme
```

:canonical: archivebox.misc.util.without_query
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.without_query
```

:canonical: archivebox.misc.util.without_fragment
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.without_fragment
```

:canonical: archivebox.misc.util.without_path
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.without_path
```

:canonical: archivebox.misc.util.path
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.path
```

:canonical: archivebox.misc.util.basename
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.basename
```

:canonical: archivebox.misc.util.domain
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.domain
```

:canonical: archivebox.misc.util.query
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.query
```

:canonical: archivebox.misc.util.fragment
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.fragment
```

:canonical: archivebox.misc.util.extension
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.extension
```

:canonical: archivebox.misc.util.base_url
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.base_url
```

:canonical: archivebox.misc.util.without_www
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.without_www
```

:canonical: archivebox.misc.util.without_trailing_slash
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.without_trailing_slash
```

:canonical: archivebox.misc.util.hashurl
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.hashurl
```

:canonical: archivebox.misc.util.urlencode
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.urlencode
```

:canonical: archivebox.misc.util.urldecode
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.urldecode
```

:canonical: archivebox.misc.util.htmlencode
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.htmlencode
```

:canonical: archivebox.misc.util.htmldecode
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.htmldecode
```

:canonical: archivebox.misc.util.short_ts
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.short_ts
```

:canonical: archivebox.misc.util.ts_to_date_str
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.ts_to_date_str
```

:canonical: archivebox.misc.util.ts_to_iso
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util.ts_to_iso
```

:canonical: archivebox.misc.util.COLOR_REGEX
:value: >
   'compile(...)'

```{autodoc2-docstring} archivebox.misc.util.COLOR_REGEX
```

:canonical: archivebox.misc.util.URL_REGEX
:value: >
   'compile(...)'

```{autodoc2-docstring} archivebox.misc.util.URL_REGEX
```

:canonical: archivebox.misc.util.parens_are_matched

```{autodoc2-docstring} archivebox.misc.util.parens_are_matched
```

:canonical: archivebox.misc.util.fix_url_from_markdown

```{autodoc2-docstring} archivebox.misc.util.fix_url_from_markdown
```

:canonical: archivebox.misc.util.find_all_urls

```{autodoc2-docstring} archivebox.misc.util.find_all_urls
```

:canonical: archivebox.misc.util.is_static_file

```{autodoc2-docstring} archivebox.misc.util.is_static_file
```

:canonical: archivebox.misc.util.enforce_types

```{autodoc2-docstring} archivebox.misc.util.enforce_types
```

:canonical: archivebox.misc.util.docstring

```{autodoc2-docstring} archivebox.misc.util.docstring
```

:canonical: archivebox.misc.util.str_between

```{autodoc2-docstring} archivebox.misc.util.str_between
```

:canonical: archivebox.misc.util.parse_date

```{autodoc2-docstring} archivebox.misc.util.parse_date
```

:canonical: archivebox.misc.util.download_url

```{autodoc2-docstring} archivebox.misc.util.download_url
```

:canonical: archivebox.misc.util.get_headers

```{autodoc2-docstring} archivebox.misc.util.get_headers
```

:canonical: archivebox.misc.util.ansi_to_html

```{autodoc2-docstring} archivebox.misc.util.ansi_to_html
```

:canonical: archivebox.misc.util.dedupe

```{autodoc2-docstring} archivebox.misc.util.dedupe
```

:canonical: archivebox.misc.util.ExtendedEncoder

Bases: {py:obj}`json.JSONEncoder`

```{autodoc2-docstring} archivebox.misc.util.ExtendedEncoder
```

```{rubric} Initialization
```

```{autodoc2-docstring} archivebox.misc.util.ExtendedEncoder.__init__
```

````{py:method} default(obj)
:canonical: archivebox.misc.util.ExtendedEncoder.default

````

:canonical: archivebox.misc.util.URL_REGEX_TESTS
:value: >
   [('https://example.com', ['https://example.com']), ('http://abc-file234example.com/abc?def=abc&23423...

```{autodoc2-docstring} archivebox.misc.util.URL_REGEX_TESTS
```

:canonical: archivebox.misc.util._test_url_strs
:value: >
   None

```{autodoc2-docstring} archivebox.misc.util._test_url_strs
```