From a terminal¶
Detailed¶
Note
False
stand for deactivated when True
stand for activated.
-ad
| --adblock
¶
Switch the decoding of the adblock format.
Default value:
False
If this argument is activated the system will extract all domains or IP from the given adblock file.
-a
| --all
¶
Output all available information on the screen.
Default value:
False
When activated:
Domain Status Expiration Date Source HTTP Code
---------------------------------------------------------------------------------------------------- ----------- ----------------- ---------- ----------
pyfunceble.readthedocs.io ACTIVE Unknown NSLOOKUP 302
When deactivated:
Domain Status HTTP Code
---------------------------------------------------------------------------------------------------- ----------- ----------
pyfunceble.readthedocs.io ACTIVE 302
-c
| --auto-continue
| --continue
¶
Switch the value of the auto continue mode.
Default value:
True
This argument activates or deactivates the auto-continue subsystem. Indeed, as we can automatically continue if the script has been stopped, this switch allows us to disable or enable the usage of that specific subsystem.
--clean
¶
Clean all files under the output directory.
As it is sometimes needed to clean our output/
directory, this argument does the job automatically.
Warning
This argument delete everything which are .keep
or .gitignore
--clean-all
¶
Clean all files under the output directory along with all file generated by PyFunceble.
Warning
This really deletes almost everything we generated without any warning.
Note
We don’t delete the whois database file/table because they are (almost) static data which are shared accross launches in your environment.
Warning
If you plan to clean manually do not delete the whois database file or table as it will make your test finish under a much longer time as usual for you.
Warning
If you don’t combine this argument alongside with the --database-type
argument or its configurable equivalent,
this argument will only clean the JSON formatted databases.
--cmd
“something”¶
Pass a command before each commit (except the final one).
Default value:
''
Note
In this example, something
should be a script or a program which have to be executed when we reached the end of the given file.
Note
This argument is only used if --travis
or travis : true
(under .PyFunceble.yaml
) are activated.
--cmd-before-end "something"
¶
Pass a command before the results (final) commit under the Travis mode.
Default value:
''
Note
In this example, something
should be a script or a program which have to be executed when we reached the end of the given file.
Note
This argument is only used if --travis
or travis : true
(under .PyFunceble.yaml
) are activated.
--commit-autosave-message "something"
¶
Replace the default autosave commit message.
Default value:
PyFunceble - AutoSave
This argument allows us to set a custom commit message which is going to be used as commit message when saving.
Note
This argument is only used if --travis
or travis : true
(under .PyFunceble.yaml
) are used.
Note
This argument is only used if we have to split the work into multiple processes because a list is too long or the timeout is reached.
Warning
Please avoid the usage of [ci skip]
here.
--commit-results-message "something"
¶
Replace the default results (final) commit message.
Default value:
PyFunceble - Results
Note
This argument is only used if --travis
or travis : true
(under .PyFunceble.yaml
) are used.
Note
This argument is only used if we reached the end of the list we are or have to test.
--complements
¶
Switch the value of the generation and test of the complements. A complement is for example
example.org
ifwww.example.org
is given and vice-versa.Default value:
False
-d "something"
| --domain "something"
¶
Set and test the given domain.
This argument will test and give the results of the tests of the given domain.
Note
For this argument (and only for this argument), we are converting the given string to lowercase.
-db
| --database
¶
Switch the value of the usage of a database to store inactive domains of the currently tested list.
Default value:
True
This argument will disable or enable the usage of a database which saves all INACTIVE and INVALID domain of the given file over time.
Note
The database is retested every x day(s), where x is the number set in -dbr "something"
.
--database-type
¶
Tell us the type of database to use. You can choose between the following:
json
,mariadb
,mysql
,sqlite
.Default value:
json
This argument let us use different types of database.
Note
This feature is applied to the following subsystems:
- Autocontinue physically located (JSON) at
output/continue.json
. - InactiveDB physically located (JSON) at
[config_dir]/inactive_db.json
. - Mining physically located (JSON) at
[config_dir]/mining.json
. - WhoisDB physically located (JSON) at
[config_dir]/whois.json
.
-dbr "something"
¶
Set the numbers of days between each retest of domains present into the database of INACTIVE and INVALID domains.
Default value:
1
Note
This argument is only used if -db
or inactive_database : true
(under .PyFunceble.yaml
) are activated.
--directory-structure
¶
Generate the directory and files that are needed and which does not exist in the current directory.
Want to start without anything? This argument generates the output directory automatically for you!
Note
In case of a file or directory not found issue, it’s recommended to remove the dir_structure.json
along with the output/ directory before using this argument.
--dns
¶
Set the DNS server(s) we have to work with. Multiple space separated DNS server can be given.
Default value:
Follow OS DNS
==>None
Warning
We expect DNS server(s). If a non-DNS server is given. You’ll get almost all results
as INACTIVE
.
-ex
| --execution
¶
Switch the default value of the execution time showing.
Default value:
False
Want to know the execution time of your test? Well, this argument will let you know!
-f "something"
| --file "something"
¶
Read the given file and test all domains inside it. If a URL is given we download and test the content of the given URL.
Note
We consider one line as one domain or one commented line. A line can be commented at the end.
Note
You can give a raw link and the system will download and test its content.
--filter "something"
¶
Domain to filter (regex).
Want to test all blogspot
from your list? This argument allows you to do that!
Note
This argument should be a regex expression.
--help
¶
Show the help message and exit.
-h
| --host
¶
Switch the value of the generation of hosts file.
Default value:
True
This argument will let the system know if it has to generate the hosts file version of each status.
--hierarchical
¶
Switch the value of the hierarchical sorting of the tested file.
Default value:
True
This argument will let the system know if we have to sort the list and our output in hierarchical order.
--http
¶
Switch the value of the usage of HTTP code.
Default value:
True
You don’t want to take the result of the HTTP code execution in consideration? This argument allows you to disable that!
Note
If activated the subsystem will bypass the HTTP status code extraction logic-representation.rst
--iana
¶
Update/Generate iana-domains-db.json.
This argument generates or updates iana-domains-db.json.
--idna
¶
Switch the value of the IDNA conversion.
Default value:
False
This argument allows the conversion of the domains using domain2idna
Warning
This feature is not supported yet for the URL testing.
-ip "something"
¶
Change the IP to print with the hosts files.
Default value:
0.0.0.0
--json
¶
Switch the value of the generation of the JSON formatted list of domains.
Default value:
False
--less
¶
When activated:
Domain Status HTTP Code
---------------------------------------------------------------------------------------------------- ----------- ----------
pyfunceble.readthedocs.io ACTIVE 302
When deactivated:
Domain Status Expiration Date Source HTTP Code
---------------------------------------------------------------------------------------------------- ----------- ----------------- ---------- ----------
pyfunceble.readthedocs.io ACTIVE Unknown NSLOOKUP 302
--local
¶
Switch the value of the local network testing.
Default value:
False
Want to run a test over a local or private network? This argument will disable the limitation which does not apply to private networks.
--link "something"
¶
Download and test the given file.
Want to test a raw link? This argument will download and test the given raw link.
--mining
¶
Switch the value of the mining subsystem usage.
Default value:
False
Want to find domain or URL linked to a domain in your list? This argument will exactly do that.
-m
| --multiprocess
¶
Switch the value of the usage of multiple process.
Default value:
False
Want to speed up the test time? This argument will allow the usage of multiple processes for testing.
-n
| --no-files
¶
Switch the value the production of output files.
Default value:
False
Want to disable the production of the outputted files? This argument is for you!
-nl
| --no-logs
¶
Switch the value of the production of logs files in the case we encounter some errors.
Default value:
False
Don’t want any logs to go out of PyFunceble? This argument disables every logs subsystem.
-ns
| --no-special
¶
Switch the value of the usage of the SPECIAL rules.
Default value:
False
Don’t want to use/apply the SPECIAL rules - which are explaines in the source column section ? This argument disable them all.
-nu
| --no-unified
¶
Switch the value of the production unified logs under the output directory.
Default value:
True
This argument disables the generation of result.txt.
-nw
| --no-whois
¶
Switch the value the usage of whois to test domain’s status.
Default value:
False
Don’t want to use or take in consideration the results from whois
? This argument allows you to disable it!
--percentage
¶
Switch the value of the percentage output mode.
Default value:
True
This argument will disable or enable the generation of the percentage of each status.
--plain
¶
Switch the value of the generation of the plain list of domains.
Default value:
False:
Want to get a list with all domain for each status? The activation of this argument does the work while testing!
-p
| --processes
¶
Set the number of simultaneous processes to use while using multiple processes.
Default value:
25
Warning
Think about your CPU before increasing this.
-psl
| --public-suffix
¶
Update/Generate public-suffix.json.
This argument will generate or update public-suffix.json.
-q
| --quiet
¶
Run the script in quiet mode.
Default value:
False
You prefer to run a program silently? This argument is for you!
-s
| --simple
¶
Switch the value of the simple output mode.
Default value:
False
Want as less as possible data on screen? This argument returns as less as possible on screen!
--split
¶
Switch the value of the split of the generated output
Default value:
True
Want to get the logs (copy of what you see on screen) on different files? This argument is suited to you!
--syntax
¶
Switch the value of the syntax test mode.
Default value:
False
-t "something"
| --timeout "something"
¶
Switch the value of the timeout.
Default value:
3
This argument will set the default timeout to apply everywhere it is possible to set a timeout.
--travis
¶
Switch the value of the Travis mode.
Default value:
False
Want to use PyFunceble under Travis CI? This argument is suited for your need!
-url "something"
| --url "something"
¶
Set and test the given URL.
Want to test the availability or an URL? Enjoy this argument!
Note
When we test the availability of an URL, we check the HTTP status code of the given URL.
-uf "something"
| --url-file "something"
¶
Read and test the list of URL of the given file. If a URL is given we download and test the list (of URL) of the given URL content.
Note
We consider one line as one URL to test.
Note
You can give a raw link and the system will download and test its content.
-ua "something"
| --user-agent "something"
¶
Set the user-agent to use and set every time we interact with everything which is not our logs sharing system.
-v
| --version
¶
Show the version of PyFunceble and exit.
-vsc
| --verify-ssl-certificate
¶
Switch the value of the verification of the SSL/TLS certificate when testing for URL.
Default value:
False
Warning
If you activate the verification of the SSL/TLS certificate, you may get false positive results.
Indeed if the certificate is not registered to the CA or is simply invalid and the domain is still alive, you will always get
INACTIVE
as output.
-wdb
| --whois-database
¶
Switch the value of the usage of a database to store whois data in order to avoid whois servers rate limit.
Default value:
True
Global overview¶
usage: PyFunceble [-ad] [-a] [-c] [--autosave-minutes AUTOSAVE_MINUTES]
[--clean] [--clean-all] [--cmd CMD]
[--cmd-before-end CMD_BEFORE_END]
[--commit-autosave-message COMMIT_AUTOSAVE_MESSAGE]
[--commit-results-message COMMIT_RESULTS_MESSAGE]
[--complements] [-d DOMAIN] [-db]
[--database-type DATABASE_TYPE]
[-dbr DAYS_BETWEEN_DB_RETEST] [--directory-structure]
[--dns DNS [DNS ...]] [-ex] [-f FILE] [--filter FILTER]
[--help] [--hierarchical] [-h] [--http] [--iana] [--idna]
[-ip IP] [--json] [--less] [--local] [--link LINK]
[--mining] [-m] [-n] [-nl] [-ns] [-nu] [-nw] [--percentage]
[--plain] [-p PROCESSES] [-psl] [-q] [--share-logs] [-s]
[--split] [--syntax] [-t TIMEOUT] [--travis]
[--travis-branch TRAVIS_BRANCH] [-u URL] [-uf URL_FILE]
[-ua USER_AGENT] [-v] [-vsc] [-wdb]
The tool to check the availability or syntax of domains, IPv4 or URL.
optional arguments:
-ad, --adblock Switch the decoding of the adblock format.
Configured value: False
-a, --all Output all available information on the screen.
Configured value: True
-c, --auto-continue, --continue
Switch the value of the auto continue mode.
Configured value: True
--autosave-minutes AUTOSAVE_MINUTES
Update the minimum of minutes before we start
committing to upstream under Travis CI.
Configured value: 15
--clean Clean all files under the output directory.
--clean-all Clean all files under the output directory along with
all file generated by PyFunceble.
--cmd CMD Pass a command to run before each commit (except the
final one) under the Travis mode. Configured
value: ''
--cmd-before-end CMD_BEFORE_END
Pass a command to run before the results (final)
commit under the Travis mode. Configured
value: ''
--commit-autosave-message COMMIT_AUTOSAVE_MESSAGE
Replace the default autosave commit message.
Configured value: 'PyFunceble -
AutoSave'
--commit-results-message COMMIT_RESULTS_MESSAGE
Replace the default results (final) commit message.
Configured value: 'PyFunceble -
Results'
--complements Switch the value of the generation and test of the
complements. A complement is for example `example.org`
if `www.example.org` is given and vice-versa.
Configured value: False
-d DOMAIN, --domain DOMAIN
Set and test the given domain.
-db, --database Switch the value of the usage of a database to store
inactive domains of the currently tested list.
Configured value: True
--database-type DATABASE_TYPE
Tell us the type of database to use. You can choose
between the following: `json|mariadb|mysql|sqlite`
Configured value: 'json'
-dbr DAYS_BETWEEN_DB_RETEST, --days-between-db-retest DAYS_BETWEEN_DB_RETEST
Set the numbers of days between each retest of domains
present into inactive-db.json. Configured
value: 1
--directory-structure
Generate the directory and files that are needed and
which does not exist in the current directory.
--dns DNS [DNS ...] Set the DNS server(s) we have to work with. Multiple
space separated DNS server can be given.
Configured value: Follow OS DNS
-ex, --execution Switch the default value of the execution time
showing. Configured value: False
-f FILE, --file FILE Read the given file and test all domains inside it. If
a URL is given we download and test the content of the
given URL.
--filter FILTER Domain to filter (regex).
--help Show this help message and exit.
--hierarchical Switch the value of the hierarchical sorting of the
tested file. Configured value: False
-h, --host Switch the value of the generation of hosts file.
Configured value: True
--http Switch the value of the usage of HTTP code.
Configured value: True
--iana Update/Generate `iana-domains-db.json`.
--idna Switch the value of the IDNA conversion.
Configured value: False
-ip IP Change the IP to print in the hosts files with the
given one. Configured value:
'0.0.0.0'
--json Switch the value of the generation of the JSON
formatted list of domains. Configured value:
False
--less Output less informations on screen.
Configured value: False
--local Switch the value of the local network testing.
Configured value: True
--link LINK Download and test the given file.
--mining Switch the value of the mining subsystem usage.
Configured value: False
-m, --multiprocess Switch the value of the usage of multiple process.
Configured value: False
-n, --no-files Switch the value of the production of output files.
Configured value: False
-nl, --no-logs Switch the value of the production of logs files in
the case we encounter some errors. Configured
value: False
-ns, --no-special Switch the value of the usage of the SPECIAL rules.
Configured value: False
-nu, --no-unified Switch the value of the production unified logs under
the output directory. Configured value:
False
-nw, --no-whois Switch the value the usage of whois to test domain's
status. Configured value: False
--percentage Switch the value of the percentage output mode.
Configured value: True
--plain Switch the value of the generation of the plain list
of domains. Configured value: False
-p PROCESSES, --processes PROCESSES
Set the number of simultaneous processes to use while
using multiple processes. Configured value:
25
-psl, --public-suffix
Update/Generate `public-suffix.json`.
-q, --quiet Run the script in quiet mode. Configured
value: False
--share-logs Switch the value of the sharing of logs.
Configured value: False
-s, --simple Switch the value of the simple output mode.
Configured value: False
--split Switch the value of the split of the generated output
files. Configured value: True
--syntax Switch the value of the syntax test mode.
Configured value: False
-t TIMEOUT, --timeout TIMEOUT
Switch the value of the timeout. Configured
value: 3
--travis Switch the value of the Travis mode.
Configured value: False
--travis-branch TRAVIS_BRANCH
Switch the branch name where we are going to push.
Configured value: 'master'
-u URL, --url URL Set and test the given URL.
-uf URL_FILE, --url-file URL_FILE
Read and test the list of URL of the given file. If a
URL is given we download and test the list (of URL) of
the given URL content.
-ua USER_AGENT, --user-agent USER_AGENT
Set the user-agent to use and set every time we
interact with everything which is not our logs sharing
system.
-v, --version Show the version of PyFunceble and exit.
-vsc, --verify-ssl-certificate
Switch the value of the verification of the SSL/TLS
certificate when testing for URL. Configured
value: False
-wdb, --whois-database
Switch the value of the usage of a database to store
whois data in order to avoid whois servers rate limit.
Configured value: True
Crafted with ♥ by Nissar Chababy (Funilrys) with the
help of https://pyfunceble.github.io/contributors.html &&
https://pyfunceble.github.io/special-thanks.html