github.com/nkoster/websocket-upload-go

Websocket Upload Golang

Upload a huge file in chunks over a websocket connection.

Based on websocket-upload, where the server is in JavaScript / nodejs.

I'm using the Golang Gorilla websocket framework for the server. Front-end JavaScript is based on a gist from Alessandro Diaferia. https://gist.github.com/alediaferia/cfb3a7503039f9278381

DISCLAIMER: I'm not sure if this is a good idea, but it actually works. This is currently a personal experiment in progress. I'm very open for comments. Also, this is my first Golang experience.

Usage, assuming you have your Go environment prepared:

git clone https://github.com/nkoster/websocket-upload-go
cd websocket-upload-go
go get github.com/gorilla/websocket
go build
./websocket-upload-go

or

go run *.go

Open http://localhost:8086 and drag-and-drop a file in the page. An uploaded file will appear in /tmp/, but you can adjust that:

./websocket-upload-go -store /store

The -store path must be absolute.

Before uploading, an MD5 sum is calculated in the browser. The MD5 sum will be used as file name, and the original file name will be saved as a symlink, pointing to the MD5 name:

/store/
  ├── files
  │   └── 166c5a55e29a73db2afd997b52e6e554
  └── links
      └── my-video.mp4 -> /store/files/166c5a55e29a73db2afd997b52e6e554

The server only saves an MD5 name once and sends a message to the browser if the MD5 name already exists. You can have multiple symlinks pointing to one MD5 name.

I'm using js-spark-md5 from André Cruz for the incremental (stream) MD5 calculation.

You can change the host and the port:

./websocket-upload-go -host example.com -port 8000

Plus, you can use this program as a simple http server to serve static files in a directory:

./websocket-upload-go -www /var/www/html

The -www path can be either relative or absolute.

In case you use this as a static http server, you can still use the websocket. Just make sure that you have your websocket URL in your JS in line with your host name and port, and stuff should work.