[](https://pypi.org/project/waybacktweets) [](https://github.com/claromes/waybacktweets/actions/workflows/docs.yml) [](https://waybacktweets.streamlit.app)
-Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see [Field Options](https://claromes.github.io/waybacktweets/field_options.html)), and saves the data in CSV, JSON, and HTML formats.
+Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see [Field Options](https://claromes.github.io/waybacktweets/field_options.html)), and saves the data in HTML (for easy viewing of the tweets using the `iframe` tag), CSV, and JSON formats.
## Installation
waybacktweets --from 20150101 --to 20191231 --limit 250 jack
```
+### Using Wayback Tweets as a Web App
+
+[Open the application](https://waybacktweets.streamlit.app), a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud.
+
### Using Wayback Tweets as a Python Module
```python
exporter.save_to_csv()
```
-### Using Wayback Tweets as a Web App
-
-[Open the application](https://waybacktweets.streamlit.app), a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud.
-
## Documentation
- [Wayback Tweets documentation](https://claromes.github.io/waybacktweets)
- OSINT Community for recommending the application.
> [!NOTE]
-> If the application is down, please check the [Streamlit Cloud Status](https://www.streamlitstatus.com/).
+> If the Streamlit application is down, please check the [Streamlit Cloud Status](https://www.streamlitstatus.com/).
"About": f"""
[](https://github.com/claromes/waybacktweets/releases) [](https://github.com/claromes/waybacktweets/blob/main/LICENSE.md) [](https://github.com/claromes/waybacktweets)
- The application is a prototype hosted on Streamlit Cloud, allowing users to apply filters and download the data in different formats.
+ The application is a prototype hosted on Streamlit Cloud, serving as an alternative to the command line tool.
© 2023 - {end_date.year}, [Claromes](https://claromes.com)
st.caption(
"[](https://github.com/claromes/waybacktweets/releases) [](https://github.com/claromes/waybacktweets)" # noqa: E501
)
-st.write("Retrieve archived tweets CDX data in CSV, JSON, and HTML formats.")
+st.write(
+ "Retrieves archived tweets CDX data in HTML (for easy viewing of the tweets using the `iframe` tag), CSV, and JSON formats." # noqa: E501
+)
st.write(
"This application uses the Wayback Tweets Python package, which can be used as a module or as a standalone command line tool. [Read the documentation](https://claromes.github.io/waybacktweets)." # noqa: E501
Pre-release: |release|
-Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see :ref:`field_options`), and saves the data in CSV, JSON, and HTML formats.
+Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see :ref:`field_options`), and saves the data in HTML (for easy viewing of the tweets using the ``iframe`` tag), CSV, and JSON formats.
.. note::
Intensive queries can lead to rate limiting, resulting in a temporary ban of a few minutes from web.archive.org.
CLI
-------------
-Using Wayback Tweets as a standalone command line tool
+Using Wayback Tweets as a standalone command line tool.
waybacktweets [OPTIONS] USERNAME
waybacktweets --from 20150101 --to 20191231 --limit 250 jack
+Web App
+-------------
+
+Using Wayback Tweets as a Streamlit Web App.
+
+`Open the application <https://waybacktweets.streamlit.app>`_, a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud.
Module
-------------
-Using Wayback Tweets as a Python Module
+Using Wayback Tweets as a Python Module.
.. code-block:: python
exporter = TweetsExporter(parsed_tweets, USERNAME, field_options)
exporter.save_to_csv()
-
-Web App
--------------
-
-Using Wayback Tweets as a Streamlit Web App
-
-`Open the application <https://waybacktweets.streamlit.app>`_, a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud.
Web App
=========
-Aplication that displays multiple archived tweets on Wayback Machine to avoid opening each link manually. The application is a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud, allowing users to apply filters and view tweets that lack the original URL.
+The application is a prototype hosted on Streamlit Cloud, serving as an alternative to the command line tool.
`Open the application <https://waybacktweets.streamlit.app>`_.
|uncheck| Unit Tests
-|uncheck| JSON Parser: Create a separate function to handle JSON return, apply JsonParser (``waybacktweets/api/parse.py:111``), and avoid rate limiting
+|uncheck| JSON Parser: Create a separate function to handle JSON return, apply JsonParser (``waybacktweets/api/parse.py:110``), and avoid rate limiting
|uncheck| Download images when tweet URL has extensions like JPG or PNG
[tool.poetry]
name = "waybacktweets"
-version = "1.0a3"
+version = "1.0a4"
description = "Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing, and saves the data."
authors = ["Claromes <support@claromes.com>"]
license = "GPLv3"