Findomain

• Fix issue with Crtsh database not handling prepared statements properly. It will improve a lot of performance and results. https://github.com/Edu4rdSHL/findomain/commit/7cd35210d4a8da39688354d565d9768afe117e50
• Minor changes. https://github.com/Edu4rdSHL/findomain/commit/bfef29e20ad05b51ca1a069aea551f907e5bda91 https://github.com/Edu4rdSHL/findomain/commit/d9e26d7cf193c8f322f3a9dc29c476deadce39c2

• Fix issue with Crtsh HTTP API causing database corruption. Crtsh has started putting \n in the name_value field of the JSON payload causing issues in the database when that subdomains where pushed. https://github.com/Edu4rdSHL/findomain/commit/3ed2cae2ce051b6526baeac51b2dc9a95419c52a
• Update rust-postgres syntax to match latest version. https://github.com/Edu4rdSHL/findomain/commit/3ed2cae2ce051b6526baeac51b2dc9a95419c52a

Optimizations:

• Remove redundant string clone. https://github.com/Edu4rdSHL/findomain/commit/b73d36cb6bb55c703d119fc66c07f1fe92ef8c58
• Bump dependencies. https://github.com/Edu4rdSHL/findomain/commit/274a966527de7730f42a74b89513f7ddefb97f3f

• Implement sanitize_subdomains function with better check for special characters in subdomains. APIs returned certain subdomains containing <br> and they were counted as valid before it release.
• Added "time wasted" counter in seconds for Findomain's operations.

Commit: https://github.com/Edu4rdSHL/findomain/commit/3ce2a838ac138d2c3115549c0789faf69ce9ae18

• Fixed error that caused the findomain_spyse_token variable to never be read because a typo. Thanks to @joeldeleep for figuring it and making the PR. https://github.com/Edu4rdSHL/findomain/commit/699f6a4aa7e18aa76ee548fd97061f450f8a07d2

• Fix multi-threading issue. Looks like that using build() isn't sufficient to spawn the number of threads that we want, so now we are just using build_global() in the main.rs file. https://github.com/Edu4rdSHL/findomain/commit/853673dcc5d8118256c7a3ffccb57c1fef6d13a7

What's new:

• Implement asynchronous subdomains resolution + various checks for safety and concurrency. https://github.com/Edu4rdSHL/findomain/commit/604d0a1ffb40731aa3df01fd5540649bce777012 https://github.com/Edu4rdSHL/findomain/commit/efd51c4e7aacf350abe4e5235737e05ac7d14612
• Add support for DNS over TLS. https://github.com/Edu4rdSHL/findomain/commit/a33b191be4d3d8ba544778da28537376b680e1d0
• Add hability to specifically perform a IPv4 lookup or IPv6 lookup. https://github.com/Edu4rdSHL/findomain/commit/f8038a4d120424f2697f1e4f26186f5f77e24c0a
• Use fully-qualified-domain-name when resolving to improve speed. https://github.com/Edu4rdSHL/findomain/commit/8e4995bc84f2217fee1737f22e014508829d6eac See https://docs.rs/trust-dns-resolver/0.18.0-alpha.1/trust_dns_resolver/struct.Resolver.html#method.lookup_ip

Misc:

• Implement return_facebook_token() function in the misc module. https://github.com/Edu4rdSHL/findomain/commit/3bf28a93ea91e2c62fda8beaacf34be0b3ee5b0d
• Add information for developers. https://github.com/Edu4rdSHL/findomain/commit/41f9c8917b19186e31c0d947884a4d018bbc94fa Thanks to @ZeroDot1.

• Implement asynchronous subdomains resolution + various checks for security and concurrency. https://github.com/Edu4rdSHL/findomain/commit/604d0a1ffb40731aa3df01fd5540649bce777012 https://github.com/Edu4rdSHL/findomain/commit/efd51c4e7aacf350abe4e5235737e05ac7d14612
• Use fully-qualified-domain-name when resolving to improve speed. https://github.com/Edu4rdSHL/findomain/commit/8e4995bc84f2217fee1737f22e014508829d6eac See https://docs.rs/trust-dns-resolver/0.18.0-alpha.1/trust_dns_resolver/struct.Resolver.html#method.lookup_ip
• Implement return_facebook_token() function in the misc module. https://github.com/Edu4rdSHL/findomain/commit/3bf28a93ea91e2c62fda8beaacf34be0b3ee5b0d
• Add information for developers. https://github.com/Edu4rdSHL/findomain/commit/41f9c8917b19186e31c0d947884a4d018bbc94fa Thanks to @ZeroDot1.

• Add possibility to use DNS over TLS. https://github.com/Edu4rdSHL/findomain/commit/a33b191be4d3d8ba544778da28537376b680e1d0
• Add hability to specifically perform a IPv4 lookup or IPv6 lookup. https://github.com/Edu4rdSHL/findomain/commit/f8038a4d120424f2697f1e4f26186f5f77e24c0a

What's new:

• Allow import of subdomains from files that were discovered by other tools and include they in the monitoring process. https://github.com/Edu4rdSHL/findomain/commit/dd6ca40b5a005408b8d047fbae0c42182bccfb04

It's a feature that will improve a lot the subdomain monitoring and centralizing process because you can run other tools like Amass, assetfinder, Sublist3r, save their results to files and then import and work with they using Findomain. Subdomains needs to be one per line in the file to import.

• Add AnubisDB to API sources. https://github.com/Edu4rdSHL/findomain/commit/e3f052c2d986b845c847cd398cbcf07e27ecbf6d

Improvements:

• Now all parameters are centralized in the same structure, mean that functions now only need to take the args structure as parameter and access to all elements from there. It makes new implementations a lot easier and also make the code more reliable when making logic comparisons while reducing the number of source lines of code. 1b5e2a3
• Define telegram_webhook URL only when required parameters are satisfied. https://github.com/Edu4rdSHL/findomain/commit/486a2877168bf68a05606c964924ce52d15b9d32 https://github.com/Edu4rdSHL/findomain/commit/abd47dd16b588027cbd32d612a9e8348a89347e6 https://github.com/Edu4rdSHL/findomain/commit/125ee1bca8233081f4c65de9b542d0cc52feb642
• Use exiting data of telegram_bot_token variable instead of reading it again. https://github.com/Edu4rdSHL/findomain/commit/abf1a823f3731292fd566e5076d0796926c7f685
• Avoid duplicated targets when reading domains from file. https://github.com/Edu4rdSHL/findomain/commit/358e730d56d7ad7bc00b27f1bdcb0118834014a2
• Avoid empty targets and sanitize domains strings when reading domains from file. https://github.com/Edu4rdSHL/findomain/commit/9ed2411c5dec3a57338702ee2aa8724b337dd45c
• Check monitoring parameters only when the -m options is specified. https://github.com/Edu4rdSHL/findomain/commit/4de13e1be953922910a1c551fea474ff2143c8a4
• Add aditional check for Telegram webhooks configuration. https://github.com/Edu4rdSHL/findomain/commit/d173e0f357ae82c947ea2b856335a1e1764c8d97
• Read environment variables only when needed. https://github.com/Edu4rdSHL/findomain/commit/1e6f88698e7f5fad49df2e58b2497f80fe554004
• Avoid unneeded monitoring flag check. https://github.com/Edu4rdSHL/findomain/commit/2d35fe7687afe4185f439b12a03b1ba65a9bd9d4
• Use flatten instead of flatmap. https://github.com/Edu4rdSHL/findomain/commit/04ff102a36e53c7a30ae692bcc52da866c37791a https://github.com/Edu4rdSHL/findomain/commit/776b9bd0571c2baeae02e6b453d8c56349c1d738
• Avoid making a HashSet per file. https://github.com/Edu4rdSHL/findomain/commit/1f122c94840e0e92ec060461b30a766f317b9ccd
• Add missing checks for subdomains imported from file. https://github.com/Edu4rdSHL/findomain/commit/3ac3726fa46cd4ba34c635a947d748dcb0f5048d
• General code optimizations.

Thanks to the beta testers of Findomain, specially to @sumgr0 for all your time and ideas.

New features:

• Allow import of subdomains from files that were discovered by other tools and include they in the monitoring process. https://github.com/Edu4rdSHL/findomain/commit/dd6ca40b5a005408b8d047fbae0c42182bccfb04

It's a feature that will improve a lot the subdomain monitoring and centralizing process because you can run other tools like Amass, assetfinder, Sublist3r, save their results to files and then import and work with they using Findomain. Subdomains needs to be one per line in the file to import.

Improvements:

• Check monitoring parameters only when the -m options is specified. https://github.com/Edu4rdSHL/findomain/commit/4de13e1be953922910a1c551fea474ff2143c8a4
• Add aditional check for Telegram webhooks configuration. https://github.com/Edu4rdSHL/findomain/commit/d173e0f357ae82c947ea2b856335a1e1764c8d97
• Read environment variables only when needed. https://github.com/Edu4rdSHL/findomain/commit/1e6f88698e7f5fad49df2e58b2497f80fe554004
• Avoid defining variables in the errors module (regression). https://github.com/Edu4rdSHL/findomain/commit/6c33584229b2c7d78d59ed5e724e75a43d703a5a
• Avoid unneeded monitoring flag check. https://github.com/Edu4rdSHL/findomain/commit/2d35fe7687afe4185f439b12a03b1ba65a9bd9d4
• Use flatten instead of flatmap. https://github.com/Edu4rdSHL/findomain/commit/04ff102a36e53c7a30ae692bcc52da866c37791a https://github.com/Edu4rdSHL/findomain/commit/776b9bd0571c2baeae02e6b453d8c56349c1d738
• Avoid making a HashSet per file. https://github.com/Edu4rdSHL/findomain/commit/1f122c94840e0e92ec060461b30a766f317b9ccd

Thanks to the beta testers of Findomain, specially to @sumgr0 for all your time and ideas.

Release edit:

The next commits where included in the current Findomain's binarys to avoid creating a new beta release:

• Add missing checks for subdomains imported from file. https://github.com/Edu4rdSHL/findomain/commit/3ac3726fa46cd4ba34c635a947d748dcb0f5048d
• Fix fatal error when the import-subdomains option was not present. https://github.com/Edu4rdSHL/findomain/commit/5ba04190cace1403ba57a724da2e65413c305c2e
• Documentation commits. https://github.com/Edu4rdSHL/findomain/commit/eab675a80e97d97be61b917b4494c731e0efefa5 https://github.com/Edu4rdSHL/findomain/commit/b597572d98cd0162185a8084a68f78ac7863113c https://github.com/Edu4rdSHL/findomain/commit/8bd1d4724d7d454329f3b7d1b8f4d887297fd68b https://github.com/Edu4rdSHL/findomain/commit/194d60bc1098e040ca79370d83c45539154d3d4d

• Define telegram_webhook URL only when required parameters are satisfied. https://github.com/Edu4rdSHL/findomain/commit/486a2877168bf68a05606c964924ce52d15b9d32 https://github.com/Edu4rdSHL/findomain/commit/abd47dd16b588027cbd32d612a9e8348a89347e6 https://github.com/Edu4rdSHL/findomain/commit/125ee1bca8233081f4c65de9b542d0cc52feb642
• Use exiting data of telegram_bot_token variable instead of reading it again. https://github.com/Edu4rdSHL/findomain/commit/abf1a823f3731292fd566e5076d0796926c7f685
• Avoid duplicated targets when reading domains from file. https://github.com/Edu4rdSHL/findomain/commit/358e730d56d7ad7bc00b27f1bdcb0118834014a2
• Avoid empty targets and sanitize domains strings when reading domains from file. https://github.com/Edu4rdSHL/findomain/commit/9ed2411c5dec3a57338702ee2aa8724b337dd45c

• There is nothing new but thinking in the future of Findomain, now all parameters are centralized in the same structure, mean that functions now only need to take the args structure as parameter and access to all elements from there. It makes new implementations a lot easier and also make the code more reliable when making logic comparisons while reducing the number of source lines of code. https://github.com/Edu4rdSHL/findomain/commit/1b5e2a30b2730809546f74dc97545cb36b3f6df4

I would appreciate it if you download this version of Findomain and do the most possible tests before it goes to the stable channel to make sure nothing is broken with the code refactoring.

• Add support for database querying.
• Fix bug when using automatic output with a target like https://target.com and the program tried to create a filename like https://target.com.txt because the target was not sanitized before parsing the filename.
• Add error message when the target or input file is empty.
• Refactor some functions and code improvements.

All was implemented in it commit: https://github.com/Edu4rdSHL/findomain/commit/a3d9f708386d1d6cb855e4f8dbcb59a4345d43b5

• Add quiet mode. https://github.com/Edu4rdSHL/findomain/commit/f48ff1c7e309c4e9edf551005c25efb0d5000d47
• Add option to see subdomains IPs as well. https://github.com/Edu4rdSHL/findomain/commit/d8c4f72f895032809f3a4020373b971d56c46d2b
• Add ability to save new domains found in a TXT file when monitoring. The files are saved in the format target-string.new_subdomains.txt for new subdomains and target-string.new_subdomains.old.txt for backup files. https://github.com/Edu4rdSHL/findomain/commit/34e6dac21b0566ceec4ca254211cace06b5cbd71
• Reimplementation of argument handling. https://github.com/Edu4rdSHL/findomain/commit/cc2963585c18361a928e89a3f77c9ae1316e8847
• General code improvements. https://github.com/Edu4rdSHL/findomain/commit/b8bc6154fb7e35e1a819f74a9624ce666a4baaae https://github.com/Edu4rdSHL/findomain/commit/bb1175045bebe9baff80e154be742f3eb2d40f3c https://github.com/Edu4rdSHL/findomain/commit/c6c4d3ac67a25ce458864a2d18e797b7c59592d3

Misc:

• Add manpage.
• Update dependencies. https://github.com/Edu4rdSHL/findomain/commit/3855577e5278f1a297c71c24f5ad1cae7d145f9f

• Added support for publishing data to Telegram webhooks. https://github.com/Edu4rdSHL/findomain/commit/34b271db150d7ca95e697f4ade3d156a281e282c

Docs:

• Added documentation to set up Telegram webhooks. https://github.com/Edu4rdSHL/findomain/commit/fb4d36a98bf368336a0bcb129dc146f8ffe4587f https://github.com/Edu4rdSHL/findomain/commit/e80d82dfe9eb6406f0309886cc2070ebbd1c9b85
• Create docs/ and images/ folders.

• Fix a bug when using the -u and -f flags at time that ends creating a new file for every domain in the list instead of an all-in-one file. https://github.com/Edu4rdSHL/findomain/commit/bde877cb262b9780f99f1e3af33f9ae14df0a1da
• Remove unneeded output for the monitoring tasks. https://github.com/Edu4rdSHL/findomain/commit/89c056b843b64b87429d8073a85ae5e6cedec361
• Remove unneeded white spaces when publishing to Slack webhook. https://github.com/Edu4rdSHL/findomain/commit/10e2a5d846302d437c5a42187cf2978df0615e03

Docs:

• Clarify jobs scheduling for subdomains monitoring. https://github.com/Edu4rdSHL/findomain/commit/866cfcdaee156bc7d539d95af19aa863f18e5dea

• Fix issue when posting to Slack API. Issue #27. Fix https://github.com/Edu4rdSHL/findomain/commit/b01c30939c755c3ccefe5e8f93726b96dc4cf4cd
• Improvements for Slack API format. https://github.com/Edu4rdSHL/findomain/commit/b07a491b49f3616ba0a7ee0b930f5daa3f15e703 https://github.com/Edu4rdSHL/findomain/commit/ce848c4bf46fc5f90b27ed800e0f02dd61502556
• Print number of new subdomains found when posting to webhooks. https://github.com/Edu4rdSHL/findomain/commit/ce848c4bf46fc5f90b27ed800e0f02dd61502556
• Avoid false-positive errors from Discord API.
• Minor documentation updates. https://github.com/Edu4rdSHL/findomain/commit/9b4e54cf2d4133700bee6d370b3b2a83d04c6253 https://github.com/Edu4rdSHL/findomain/commit/3db818a11aa926dc7059d50628b1b1f3d4903853

• Subdomains monitoring is there! Now Findomain can tell you where is a new subdomain for a specific target or a list of targets and push the data to Slack or Discord webhooks. See https://git.io/JeZQW for more information. https://github.com/Edu4rdSHL/findomain/commit/0e37bdaf2da11e6d1e3194dec80daae5c0577b94
• Avoid continuous output when using the -u option. https://github.com/Edu4rdSHL/findomain/commit/75146c3e19866dfaf432577943e9e42b067576d2

Misc:

• Added financial contributors to the README. https://github.com/Edu4rdSHL/findomain/commit/ae3a007a85b4173b44cee8d2d585acb1f8c04c4a
• General code improvements.

• Add support for writing to unique file for one or multiple targets. https://github.com/Edu4rdSHL/findomain/commit/8e4909fec02fdd0301529d49bf2f0576593f63b0
• Add support for working with resolved subdomains only -r/--resolved flags / Remove -i/--ip option. https://github.com/Edu4rdSHL/findomain/commit/8765694d50fea5226d85eb69330b586011938b81

Misc:

• Refactor some functions and remove duplicate code. Thanks to @kpcyrd. https://github.com/Edu4rdSHL/findomain/commit/b5e02eaf7f3e6bf02f41a16d17d2007f9031b855
• General code improvements.

• Avoid false positives in subdomains data. See https://github.com/Edu4rdSHL/findomain/commit/1fe5e757d7d8fe2d0b6f2e0e69df72977241393e for details.