Jay Taylor's notes

back to listing index

daviddengcn/gcse

[web search]
Original source (github.com)
Tags: golang go search-engine github.com
Clipped on: 2018-04-05
Project for Go Search, a search engine for finding popular and relevant packages. http://go-search.org/
Go HTML CSS Protocol Buffer JavaScript Batchfile
chrome-app ADD easybi 2 years ago
configs Add more non go sub folder names. Refactoring of configs package usage. 2 years ago
pipelines fix typo 2 years ago
proto Fix some bugs, and do some refactoring 2 years ago
scripts Fix some bugs, and do some refactoring 2 years ago
server replace Flash content by clipboard.js 2 years ago
spider Add more non go sub folder names. Refactoring of configs package usage. 2 years ago
store Fix some bugs, and do some refactoring 2 years ago
tools Add more non go sub folder names. Refactoring of configs package usage. 2 years ago
utils Fix some bugs, and do some refactoring 2 years ago
.gitignore Change along with sophie change 2 years ago
ACKNOWLEDGEMENTS Create ACKNOWLEDGEMENTS 4 years ago
LICENSE Create LICENSE 4 years ago
README.md Update README.md 4 years ago
bi.go Fix setting of bi data path 2 years ago
conf.json.template ADD easybi 2 years ago
crawler.bat made it so the bats will work with any GOPATH 5 years ago
crawler.go Fix some bugs, and do some refactoring 2 years ago
crawler_test.go Check name pattern before add sub folders as new candidates 2 years ago
crawlerdb.go Add found_way of github updates 2 years ago
data.go Check name pattern before add sub folders as new candidates 2 years ago
data_test.go Use bytesp.Slice 3 years ago
db.go Use golangplus 3 years ago
db_test.go Change test package 3 years ago
gcse.go Fix some bugs, and do some refactoring 2 years ago
index.go Fix some bugs, and do some refactoring 2 years ago
index_test.go Change along with sophie change 2 years ago
indexer.bat made it so the bats will work with any GOPATH 5 years ago
license.txt Various minor update for spelling and links. 5 years ago
ranking.go Fix bug of description not in index. 2 years ago
ranking_test.go Change test package 3 years ago
server.bat made it so the bats will work with any GOPATH 5 years ago
text.go Use golangplus 3 years ago
text_test.go Change test package 3 years ago
tokenize_test.go Add counters for index age 2 years ago
utils.go Fix some bugs, and do some refactoring 2 years ago

README.md

Go Search

A keyword search engine helping people to find popular and relevant Go packages.

Online service: Go Search

This is the root package with shared functions.

Sub packages are commands for running:

  • HTTP Server: Searching and web service
  • ToCrawl: Find packages to crawl.
  • Crawler: Crawling package files.
  • MergeDocs: Merge crawled package files with doc DB.
  • Indexer: Analyzing package information and generating indexed data for searching.

Development

You'll need to perform the following steps to get a basic server running:

  1. Create a basic conf.json file, limiting the crawler to a one minute run: { "crawler": { "due_per_run": "1m" } }
  2. Run the package finder: go run tocrawl/*.go
  3. Run the crawler: go run crawler/*.go
  4. Merge the crawled docs: go run mergedocs/*.go
  5. Run the indexer: go run indexer/*.go
  6. Run the server: go run server/*.go
  7. Visit http://localhost:8080 in your browser

LICENSE

BSD license.

Press h to open a hovercard with more details.