New Case Study:See how Anthropic automated 95% of dependency reviews with Socket.Learn More
Socket
Sign inDemoInstall
Socket

github.com/acho01/map-reduce

Package Overview
Dependencies
Alerts
File Explorer
Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

github.com/acho01/map-reduce

  • v0.0.0-20211110090927-61b1ccff12d6
  • Source
  • Go
  • Socket score

Version published
Created
Source

Map-Reduce

Current distributed map-reduce implementation is based on google's paper: https://pdos.csail.mit.edu/6.824/papers/mapreduce.pdf No fault tolerance, or real-life issues is supported in this implementation. Framework is fully implemented in Golang.

How to run

To start controller server with test input files you can run this commmand: go run commons.go rpc.go controller.go ./input_files/pg-*.txt

You can simulation distrubuted behaviour by creating several worker processes. You can run this command to create single worker: go run commons.go rpc.go worker.go

Finally you will get N mr-out-(0:N) files, where N is number of started workers. You can see the word count results using: cat mr-out-* | sort | more

FAQs

Package last updated on 10 Nov 2021

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap
  • Changelog

Packages

npm

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc