Skip to content

chore: update dependencies for prost, nix, and protobuf#158

Closed
alamb wants to merge 3 commits into
tikv:masterfrom
alamb:alamb/update_prostish_2
Closed

chore: update dependencies for prost, nix, and protobuf#158
alamb wants to merge 3 commits into
tikv:masterfrom
alamb:alamb/update_prostish_2

Conversation

@alamb

@alamb alamb commented Aug 17, 2022

Copy link
Copy Markdown
Contributor

Updates all dependencies to keep up with ecosystem

Closes #153
Closes #154
Closes #155
Closes #156

@alamb alamb changed the title chore: update dependencies chore: update dependencies for prost, nix, and protobuf Aug 17, 2022
@alamb alamb force-pushed the alamb/update_prostish_2 branch from 59ef9bc to 5294f17 Compare August 17, 2022 10:58
@alamb

alamb commented Aug 17, 2022

Copy link
Copy Markdown
Contributor Author

cc @YangKeao @Xuanwo

@Xuanwo

Xuanwo commented Aug 17, 2022

Copy link
Copy Markdown
Member

Mostly LGTM.

But as discussed in #136, we do have concerns on the adoption of protobuf v3.

Maybe skip the protobuf this time?

alamb added 2 commits August 18, 2022 10:15
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
@alamb alamb force-pushed the alamb/update_prostish_2 branch from a1ecbdb to 0ca4ed5 Compare August 18, 2022 14:15
@alamb

alamb commented Aug 18, 2022

Copy link
Copy Markdown
Contributor Author

Maybe skip the protobuf this time?

Thanks -- PR has been upgraded

@YangKeao YangKeao left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@alamb

alamb commented Aug 18, 2022

Copy link
Copy Markdown
Contributor Author

🎉

@YangKeao

Copy link
Copy Markdown
Member

I wonder why this PR doesn't trigger any CI

@YangKeao

Copy link
Copy Markdown
Member

https://github.com/tikv/pprof-rs/actions/runs/2883100562 It has been queued for a long time. It seems that the github has some bugs 🤦

@Xuanwo

Xuanwo commented Aug 19, 2022

Copy link
Copy Markdown
Member

https://github.com/tikv/pprof-rs/actions/runs/2883100562 It has been queued for a long time. It seems that the github has some bugs facepalm

Please ping a tikv's maintianer to check the runner status of the tikv org.

Seems other projects also been blocked, FYI: tikv/raft-rs#460

@alamb

alamb commented Aug 21, 2022

Copy link
Copy Markdown
Contributor Author

Please ping a tikv's maintianer to check the runner status of the tikv org.

Hi @Xuanwo -- how would I find who are the tikv maintainers?

Should I look for people merging stuff in https://github.com/tikv/tikv?

@YangKeao

Copy link
Copy Markdown
Member

Please ping a tikv's maintianer to check the runner status of the tikv org.

Hi @Xuanwo -- how would I find who are the tikv maintainers?

Should I look for people merging stuff in https://github.com/tikv/tikv?

It looks fine now 👍

…tish_2

Signed-off-by: YangKeao <yangkeao@chunibyo.icu>
@YangKeao

Copy link
Copy Markdown
Member

The new version of prost_build removes the vendored protoc, which means it requires our user to pre-install the protoc to compile any libraries / binaries depend on the pprof with prost.

How do you think about it? @sticnarf @BusyJay

@sticnarf

Copy link
Copy Markdown
Contributor

The new version of prost_build removes the vendored protoc, which means it requires our user to pre-install the protoc to compile any libraries / binaries depend on the pprof with prost.

How do you think about it? @sticnarf @BusyJay

It is possible that the user of pprof-rs does not use prost-build because they don't have their own proto files. So, it may be a bit unfriendly to require all users to install protoc.

As the proto in pprof-rs does not change frequently, I think it may be acceptable to build the proto into rs file manually before publishing the crate.

@benesch

benesch commented Aug 29, 2022

Copy link
Copy Markdown

As the proto in pprof-rs does not change frequently, I think it may be acceptable to build the proto into rs file manually before publishing the crate.

This is what the prost maintainer recommends as well!

The one thing I think going for us in this area is that I don't think there are a large amount of libs that use tonic directly and/or with gRPC users can generally include the protobuf themselves. That said, I think the real solution moving forward is to check in the generated protobuf.

tokio-rs/prost#657 (comment)

@alamb

alamb commented Aug 31, 2022

Copy link
Copy Markdown
Contributor Author

So is the consensus to check in the generated .rs files and remove the dependency on prost-build?

@YangKeao

YangKeao commented Sep 1, 2022

Copy link
Copy Markdown
Member

So is the consensus to check in the generated .rs files and remove the dependency on prost-build?

Yes 😸 ! But I haven't found the best practice to generate files under the source directory. Should we add a binary rust crate to call prost-build to help us generate the files? Do you have any suggestions?

@tustvold

tustvold commented Sep 1, 2022

Copy link
Copy Markdown

Should we add a binary rust crate to call prost-build to help us generate the files? Do you have any suggestions?

You could look into using https://github.com/neoeinstein/protoc-gen-prost

@alamb

alamb commented Sep 4, 2022

Copy link
Copy Markdown
Contributor Author

I do not think I will have time to work on this ticket for at least the next several weeks. If anyone else is interested, it would be great to work on it.

This is relatively low on my priority list, so I may also just inline the pprof crate into our project and make the needed changes there (as we have already setup protoc in our build environments)

Thank you all for your comments

@alamb

alamb commented Sep 25, 2023

Copy link
Copy Markdown
Contributor Author

It appears this change was done by @sticnarf in #166

@alamb alamb closed this Sep 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants