
The tool to check the availability or syntax of domain, IP or URL.¶





Welcome to PyFunceble!
PyFunceble is the little sister of Funceble which was archived on 13th March 2018. In March 2018, because Funceble was starting to become a huge unmanageable script, I - Nissar Chababy aka @funilrys - decided to make it a Python tool for the purpose of extending my Python knowledge. It was meant for my own use case.
Back then, my problem was that I didn’t want to download a huge hosts file knowing that most of the entries do not exist anymore. That’s how Py-Funceble started.
My objective - now - through this tool is to provide a tool and a Python API which helps the world test the availability of domains, IPs and URL through the gathering and interpretation of information from existing tools or protocols like WHOIS records, DNS lookup, or even HTTP status codes.
The base of this tool was my idea. But as with many Open Source (related) projects, communities or individuals, we evolve with the people we meet, exchange with or just discuss with privately. PyFunceble was and is still not an exception to that.
My main idea was to check the availability of domains in hosts files. But 3 years later, PyFunceble is now capable of a lot including:
- The testing of domains, IPs, and URLs.
- The checking of the syntax or reputation of a domain, IPs, and URLs.
- The decoding of AdBlock filters, RPZ records, or plain files before a test from the CLI.
PyFunceble evolved and will probably continue to evolve with the time and the people using it.
In June 2020, The PyFunceble-dev PyPI package - which gets everything as soon as possible compared to the PyFunceble (stable) package - reached 1 million total downloads. I never noticed it until I was reached by someone informing me of it. But, I was shocked.
I never thought that something I built from A to Z in my free time will ever reach that point. I was thankful to that nice person for informing me of it. But at the same time concerned about PyFunceble and how it will evolve. That’s why I started the development of PyFunceble 4.0.0. My idea as I was refactoring it was to provide a better Python API and implementation of my core ideas along with a better incorporation and extension capability. Indeed, in the last few years, I was so much obsessed with the CLI that I really never wrote each component individually. They were all dependent - if not part of - the CLI. With 4.0.0, you can now import one of the components of PyFunceble and start straight away. No real need to play with the configuration unless you want something very specific. That’s how I see the future of PyFunceble.
As of today, PyFunceble is running actively - if not daily - within several servers, laptops, PCs, and Raspberry Pis. It is even used - thanks to our auto continue dataset and component - with CI engines like GitHub Action, Travis CI, and GitLab CI.
PyFunceble is my tool. But it is indirectly also become yours. Therefore, I invite you to let me know how you use PyFunceble or simply open a discussion - or join an existing one - about anything you do with PyFunceble. But also anything that you - would - like - or dislike - in PyFunceble.
Happy testing with PyFunceble!
- Configuration
- Location
- Autoconfiguration
- Indexes
share_logs
verify_ssl_certificate
debug
cli_decoding
cli_testing
cli_testing[hosts_ip]
cli_testing[max_workers]
cli_testing[autocontinue]
cli_testing[inactive_db]
cli_testing[whois_db]
cli_testing[complements]
cli_testing[cooldown_time]
cli_testing[db_type]
cli_testing[file_filter]
cli_testing[mining]
cli_testing[local_network]
cli_testing[preload_file]
cli_testing[ci]
cli_testing[display_mode]
cli_testing[display_mode][dots]
cli_testing[display_mode][dots]
cli_testing[display_mode][execution_time]
cli_testing[display_mode][percentage]
cli_testing[display_mode][quiet]
cli_testing[display_mode][less]
cli_testing[display_mode][all]
cli_testing[display_mode][simple]
cli_testing[display_mode][status]
cli_testing[display_mode][colour]
cli_testing[testing_mode]
cli_testing[days_between]
cli_testing[sorting_mode]
cli_testing[file_generation]
lookup
dns
user_agent
http_codes
links
- Usage
- From a terminal
- From a GitLab CI/CD environment
- From a Travis CI container
- Using the PyFunceble (Python) API
- Get the availability of domains or IP
- Get the availability of URL
- Complete dataset while getting the avaibility of domains, IPs or URL
- Set custom configuration index while getting the avaibility of domains, IPs or URL
- Globally
- Check the syntax of domains
- Check the syntax of IPv4s
- Check the syntax of URLs
- Responses
- Subject
- Status
- Source
_status
(API)_status_source
(API)dns_lookup
(API)- HTTP Code
- Expiration Date
whois_record
(API)whois_server
(API)domain_syntax_validation
(API)subdomain_syntax_validation
(API)url_syntax_validation
(API)ipv4_syntax_validation
(API)ipv6_syntax_validation
(API)ipv4_range_syntax_validation
(API)ipv6_range_syntax_validation
(API)
- Components
- AdBlock/Filter list decoding
- Autocontinue
- Certificate verification
- Cleaning
- Complements Generation
- Configuration
- Continuous Integration
- Custom DNS Protocol
- Custom DNS Server
- Custom User-Agent
- Databases
- Directory Structure
- DNS Lookup
- Environment variables
- Execution time
- List filtering
- IANA Root Zone Database
- Test in/for local hostnames, IPs, components
- Logs Sharing
- Mining
- Multithreading
- Outputted Files
- Percentage
- The Public Suffix List
- Sorting
- Whois Lookup
- Code Documentation
- PyFunceble package
- Subpackages
- PyFunceble.checker package
- PyFunceble.cli package
- PyFunceble.config package
- PyFunceble.converter package
- Submodules
- PyFunceble.converter.adblock_input_line2subject module
- PyFunceble.converter.base module
- PyFunceble.converter.input_line2subject module
- PyFunceble.converter.internal_url module
- PyFunceble.converter.rpz_input_line2subject module
- PyFunceble.converter.rpz_policy2subject module
- PyFunceble.converter.subject2complements module
- PyFunceble.converter.url2netloc module
- PyFunceble.converter.wildcard2subject module
- Module contents
- PyFunceble.data package
- PyFunceble.database package
- PyFunceble.dataset package
- Subpackages
- Submodules
- PyFunceble.dataset.base module
- PyFunceble.dataset.csv_base module
- PyFunceble.dataset.db_base module
- PyFunceble.dataset.iana module
- PyFunceble.dataset.ipv4_reputation module
- PyFunceble.dataset.mariadb_base module
- PyFunceble.dataset.public_suffix module
- PyFunceble.dataset.user_agent module
- Module contents
- PyFunceble.downloader package
- PyFunceble.helpers package
- Submodules
- PyFunceble.helpers.command module
- PyFunceble.helpers.dict module
- PyFunceble.helpers.directory module
- PyFunceble.helpers.download module
- PyFunceble.helpers.environment_variable module
- PyFunceble.helpers.exceptions module
- PyFunceble.helpers.file module
- PyFunceble.helpers.hash module
- PyFunceble.helpers.list module
- PyFunceble.helpers.merge module
- PyFunceble.helpers.regex module
- Module contents
- PyFunceble.query package
- PyFunceble.utils package
- Submodules
- PyFunceble.exceptions module
- PyFunceble.facility module
- PyFunceble.factory module
- PyFunceble.logger module
- PyFunceble.sessions module
- PyFunceble.storage module
- PyFunceble.storage_facility module
- Module contents
- Subpackages
- PyFunceble package