Issues Installing

[Cortexelus]

Installation instructions need some updating.

On a fresh EC2 machine w/ Ubuntu or Amazon Linux---

installation method 1

go get -v github.com/tmbdev/tarp/tarp =>

go: go.mod file not found in current directory or any parent directory.
	'go get' is no longer supported outside a module.
	To build and install a command, use 'go install' with a version,
	like 'go install example.com/cmd@latest'
	For more information, see https://golang.org/doc/go-get-install-deprecation
	or run 'go help get' or 'go help install'. 

installation method 1.5

go install github.com/tmbdev/tarp/tarp@latest =>

go: github.com/tmbdev/tarp/tarp@latest (in github.com/tmbdev/tarp/tarp@v0.0.0-20221009163818-4aac5677b928):
	The go.mod file for the module providing named packages contains one or
	more replace directives. It must not contain directives that would cause
	it to be interpreted differently than if it were the main module.

installation method 2:

make bin/tarp =>

cd tarp && make tarp
make[1]: Entering directory `/home/ec2-user/tarp/tarp'
go clean
go mod tidy
go: downloading github.com/dgraph-io/badger/v3 v3.2103.2
go: downloading github.com/jessevdk/go-flags v1.5.0
go: downloading github.com/shamaton/msgpack v1.2.1
go: downloading github.com/dgraph-io/ristretto v0.1.0
go: downloading github.com/dustin/go-humanize v1.0.0
go: downloading github.com/golang/protobuf v1.5.2
go: downloading github.com/pkg/errors v0.9.1
go: downloading go.opencensus.io v0.23.0
go: downloading golang.org/x/sys v0.0.0-20221006211917-84dc82d7e875
go: downloading github.com/stretchr/testify v1.6.1
go: downloading github.com/Masterminds/squirrel v1.5.3
go: downloading github.com/mattn/go-sqlite3 v1.14.15
go: downloading gopkg.in/zeromq/goczmq.v4 v4.1.0
go: downloading github.com/gogo/protobuf v1.3.2
go: downloading github.com/golang/snappy v0.0.4
go: downloading github.com/google/flatbuffers v22.9.29+incompatible
go: downloading github.com/cespare/xxhash v1.1.0
go: downloading github.com/klauspost/compress v1.15.11
go: downloading golang.org/x/net v0.0.0-20221004154528-8021a29435af
go: downloading github.com/cespare/xxhash/v2 v2.1.2
go: downloading github.com/golang/glog v1.0.0
go: downloading github.com/dgryski/go-farm v0.0.0-20200201041132-a6ae2369ad13
go: downloading google.golang.org/protobuf v1.28.1
go: downloading github.com/google/go-cmp v0.5.5
go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
go: downloading github.com/lann/builder v0.0.0-20180802200727-47ae307949d0
go: downloading github.com/davecgh/go-spew v1.1.1
go: downloading github.com/pmezard/go-difflib v1.0.0
go: downloading gopkg.in/yaml.v3 v3.0.0-20200313102051-9f266ea9e77c
go: downloading github.com/OneOfOne/xxhash v1.2.2
go: downloading github.com/spaolacci/murmur3 v1.1.0
go: downloading github.com/lann/ps v0.0.0-20150810152359-62de8c46ede0
go: downloading golang.org/x/xerrors v0.0.0-20200804184101-5ec99f83aff1
go get -u
go: downloading github.com/dgraph-io/badger/v3 v3.2103.3
go: downloading github.com/dgraph-io/badger v1.6.2
go: downloading github.com/tmbdev/tarp v0.0.2
go: downloading github.com/dgraph-io/ristretto v0.1.1
go: downloading golang.org/x/sys v0.1.0
go: downloading github.com/mattn/go-sqlite3 v1.14.16
go: downloading github.com/google/flatbuffers v22.10.26+incompatible
go: downloading github.com/klauspost/compress v1.15.12
go: downloading golang.org/x/net v0.1.0
go: upgraded github.com/dgraph-io/badger/v3 v3.2103.2 => v3.2103.3
go: upgraded github.com/dgraph-io/ristretto v0.1.0 => v0.1.1
go: upgraded github.com/google/flatbuffers v22.9.29+incompatible => v22.10.26+incompatible
go: upgraded github.com/klauspost/compress v1.15.11 => v1.15.12
go: upgraded github.com/mattn/go-sqlite3 v1.14.15 => v1.14.16
go: upgraded github.com/tmbdev/tarp/dpipes v0.0.0-20220223203531-468ca2eefc90 => v0.0.0-20221009163818-4aac5677b928
go: upgraded golang.org/x/net v0.0.0-20221004154528-8021a29435af => v0.1.0
go: upgraded golang.org/x/sys v0.0.0-20221006211917-84dc82d7e875 => v0.1.0
go build -ldflags "-X main.version=`date -Iseconds`" -o tarp split.go sort.go main.go cat.go proc.go create.go
# pkg-config --cflags  -- libczmq libzmq libsodium
Package libczmq was not found in the pkg-config search path.
Perhaps you should add the directory containing `libczmq.pc'
to the PKG_CONFIG_PATH environment variable
No package 'libczmq' found
Package libzmq was not found in the pkg-config search path.
Perhaps you should add the directory containing `libzmq.pc'
to the PKG_CONFIG_PATH environment variable
No package 'libzmq' found
Package libsodium was not found in the pkg-config search path.
Perhaps you should add the directory containing `libsodium.pc'
to the PKG_CONFIG_PATH environment variable
No package 'libsodium' found
pkg-config: exit status 1
make[1]: *** [tarp] Error 2
make[1]: Leaving directory `/home/ec2-user/tarp/tarp'
make: *** [bin/tarp] Error 2

[sayakpaul]

You need to separately install libczmq and libsodium and then proceed with the installation. go get ... has been deprecated so, I followed the make way.

[hhoeflin]

I had the same issue as well. This was quite confusing. The shell.nix indicates that go-1.18 was last used for development of this repo. It would be helpful in the README to point this out!

And thanks for the package, I am using it in my work and tarp was very helpful.

[CharlesHolbrow]

Should tarp be usable on MacOS? I'm having the same issues described by OP despite having installed libsodium and zeromq. I'm on MacOS 12.6.2 (Intel).

brew install libsodium zeromq
make bin/tarp

Using the commands above I get the same error as @Cortexelus.

[ivankukuljan]

Dear All,

I'm having the same problems on my Ubuntu 20.04.3 LTS as people have listed above. I've installed libczmq and libsodium following @sayakpaul 's advice. But
make bin/tarp
still gives me
cd tarp && make install make[1]: Entering directory '/home/kivan/tarp/tarp/tarp/tarp' go clean go mod tidy github.com/tmbdev/tarp/tarp imports github.com/dgraph-io/badger/v3 imports github.com/dgraph-io/badger/v3/y imports github.com/klauspost/compress/zstd tested by github.com/klauspost/compress/zstd.test imports github.com/klauspost/compress/zip imports io/fs: malformed module path "io/fs": missing dot in first path element github.com/tmbdev/tarp/tarp imports github.com/dgraph-io/badger/v3 imports github.com/dgraph-io/badger/v3/y imports github.com/klauspost/compress/zstd tested by github.com/klauspost/compress/zstd.test imports github.com/klauspost/compress/zip tested by github.com/klauspost/compress/zip.test imports testing/fstest: malformed module path "testing/fstest": missing dot in first path element make[1]: *** [Makefile:6: tarp] Error 1 make[1]: Leaving directory '/home/kivan/tarp/tarp/tarp/tarp' make: *** [Makefile:15: install] Error 2
Any suggestions?

[cinjon]

I'm having similar troubles installing with make. On Ubuntu and Mac, after working through a series of errors around packages, I invariably get to:

cd tarp && make tarp
go clean
go mod tidy
go get -u
go: upgraded github.com/Masterminds/squirrel v1.5.3 => v1.5.4
go: upgraded github.com/cespare/xxhash/v2 v2.1.2 => v2.2.0
go: upgraded github.com/dgraph-io/badger/v3 v3.2103.2 => v3.2103.5
go: upgraded github.com/dgraph-io/ristretto v0.1.0 => v0.1.1
go: upgraded github.com/dustin/go-humanize v1.0.0 => v1.0.1
go: upgraded github.com/golang/glog v1.0.0 => v1.1.2
go: upgraded github.com/golang/protobuf v1.5.2 => v1.5.3
go: upgraded github.com/google/flatbuffers v22.9.29+incompatible => v23.5.26+incompatible
go: upgraded github.com/klauspost/compress v1.15.11 => v1.17.1
go: upgraded github.com/mattn/go-sqlite3 v1.14.15 => v1.14.17
go: upgraded github.com/tmbdev/tarp/dpipes v0.0.0-20220223203531-468ca2eefc90 => v0.0.0-20221009163818-4aac5677b928
go: upgraded go.opencensus.io v0.23.0 => v0.24.0
go: upgraded golang.org/x/net v0.0.0-20221004154528-8021a29435af => v0.17.0
go: upgraded golang.org/x/sys v0.0.0-20221006211917-84dc82d7e875 => v0.13.0
go: upgraded google.golang.org/protobuf v1.28.1 => v1.31.0
go build -ldflags "-X main.version=`date -Iseconds`" -o tarp cat.go create.go main.go proc.go sort.go split.go
tarp -h
make[1]: tarp: No such file or directory
make[1]: *** [tarp] Error 1
make: *** [bin/tarp] Error 2

Hard to tell what's the issue. I tried go-current, go-1.18, and go-1.19 on Ubuntu. The go-1.18 distribution doesnt work because some packages require go-1.19 at least. The other two failed with the above.

[pantelis]

In Ubuntu 22.04

sudo apt-get install libczmq-dev
sudo apt-get install libsodium-dev

I then followed this approach

git clone https://github.com/tmbdev/tarp.git
cd tarp
make bin/tarp
sudo make install

and with go version go1.22.2 linux/amd64, the installation was completed successfully minus the error message "make[1]: tarp: No such file or directory" which does not impact its usage.