A Go (Golang) package designed for extracting, parsing, and manipulating URLs with ease. This library is useful for developers who need to work with URLs in a structured way.
MIT License
hq-go-url
is a Go (Golang) package designed for extracting, parsing, and manipulating URLs with ease. This library is useful for developers who need to work with URLs in a structured way.
net/url
package in Go with additional fields and capabilities.To install the package, run the following command in your terminal:
go get -v -u github.com/hueristiq/hq-go-url
This command will download and install the hq-go-url
package into your Go workspace, making it available for use in your projects.
Below are examples demonstrating how to use the different features of the hq-go-url
package.
You can extract URLs from a given text string using the Extractor. Here's a simple example:
package main
import (
"fmt"
hqgourl "github.com/hueristiq/hq-go-url"
"regexp"
)
func main() {
extr := hqgourl.NewExtractor()
text := "Check out this website: https://example.com and send an email to [email protected]."
regex := extr.CompileRegex()
matches := regex.FindAllString(text, -1)
fmt.Println("Found URLs:", matches)
}
You can customize how URLs are extracted by specifying URL schemes, hosts, or providing custom regular expression patterns.
Extract URLs with Specific Schemes (e.g., HTTP, HTTPS, FTP):
extr := hqgourl.NewExtractor(
hqgourl.ExtractorWithSchemePattern(`(?:https?|ftp)://`),
)
This configuration will extract only URLs starting with http, https, or ftp schemes.
Extract URLs with Custom Host Patterns (e.g., example.com):
extr := hqgourl.NewExtractor(
hqgourl.ExtractorWithHostPattern(`(?:www\.)?example\.com`),
)
This setup will extract URLs that have hosts matching www.example.com or example.com.
[!NOTE] Since API is centered around regexp.Regexp, many other methods are available
The DomainParser
can parse domains into their components, such as subdomains, root domains, and TLDs:
package main
import (
"fmt"
hqgourl "github.com/hueristiq/hq-go-url"
)
func main() {
dp := hqgourl.NewDomainParser()
parsedDomain := dp.Parse("subdomain.example.com")
fmt.Printf("Subdomain: %s, Root Domain: %s, TLD: %s\n", parsedDomain.Sub, parsedDomain.Root, parsedDomain.TopLevel)
}
The Parser
provides an extended way to parse URLs, including additional fields like port and file extension:
package main
import (
"fmt"
hqgourl "github.com/hueristiq/hq-go-url"
)
func main() {
up := hqgourl.NewParser()
parsedURL, err := up.Parse("https://subdomain.example.com:8080/path/file.txt")
if err != nil {
fmt.Println("Error parsing URL:", err)
return
}
fmt.Printf("Subdomain: %s\n", parsedURL.Domain.Sub)
fmt.Printf("Root Domain: %s\n", parsedURL.Domain.Root)
fmt.Printf("TLD: %s\n", parsedURL.Domain.TopLevel)
fmt.Printf("Port: %d\n", parsedURL.Port)
fmt.Printf("File Extension: %s\n", parsedURL.Extension)
}
Set a default scheme:
up := hqgourl.NewParser(hqgourl.ParserWithDefaultScheme("https"))
We welcome contributions! Feel free to submit Pull Requests or report Issues. For more details, check out the contribution guidelines.
This package is licensed under the MIT license. You are free to use, modify, and distribute it, as long as you follow the terms of the license. You can find the full license text in the repository - Full MIT license text.
A huge thanks to all the contributors who have helped make hq-go-url
what it is today!
If you're interested in more packages like this, check out:
DomainParser urlx xurls goware's tldomains jakewarren's tldomains