upvote

points

by FabCH5 hours ago |
comments
upvoteby xeyownt4 hours ago|
next
[-]
Fair enough.

But then I would rephrase that because it's confusing, and not doing justice to your tool.

reply
upvoteby FabCH4 hours ago|
parent|
[-]
Good point.

Thanks!

reply
upvoteby grey-area3 hours ago|
prev|
next
[-]
Perhaps it could just check the length of files and not crash?!? Don’t you think that’s sensible?
reply
upvoteby FabCH3 hours ago|
parent|
[-]
It's a tradeoff. The length itself is not a problem. It will happily diff normal multi-MB files.

The problem is the degenerative syntax tree that TreeSitter produces in case of, for example a multi-million array of bytes. This causes a stack overflow in the TreeSitter C code which takes down the Rust process with it.

The correct solution would be to prevent TS from crashing, or isolate the C<->Rust boundary better.

Or just, not support that for v0.3. Because if you are diffing the collected works of Shakespeare as a binary blob in a C++ header, maybe diffing isn't your biggest problem.

reply
upvoteby dmitrygr3 hours ago|
prev|
[-]
> Editors don’t even open those files.

vi opens multi-GB files just fine.

And for multi-TB files, "less -n" works.

You need to broaden your horizons about editors. Not all of then are javascript-based slopfests

reply
upvoteby FabCH3 hours ago|
parent|
[-]
The crash will happen in TreeSitter which is a widely used AST library that all modern editors, including neovim, depend on for syntax highlighting and which is also used by many LSPs.

Additionally, here's an appropriate XKCD: https://xkcd.com/378/

reply
upvoteby dmitrygr20 minutes ago|
parent|
[-]
Please demonstrate that crash on “less -n” or vim with no plugins. I just happily opened a multi gb file in both. No issue
reply