Staredit Network > Forums > Technology & Computers > Topic: Splitting a large file into smaller individual files
Splitting a large file into smaller individual files
Apr 28 2015, 5:17 am
By: rockz  

Apr 28 2015, 5:17 am rockz Post #1

ᴄʜᴇᴇsᴇ ɪᴛ!

There's a million programs out there which will take a large file and split it up in 500 MB increments, but I'd like to split up a large text file (or binary file) and search for header text.

For example, if I have a text file like this:
Code
NEWFILE:The rain in Spain falls mainly on the plain.NEWFILE:Some people just want to watch the world burn.NEWFILE:When is a door not a door?

I want 3 files to be output with the following text in them:

The rain in Spain falls mainly on the plain.
Some people just want to watch the world burn.
When is a door not a door?

There has got to be an easy way to do this that someone has already come up with.



"Parliamentary inquiry, Mr. Chairman - do we have to call the Gentleman a gentleman if he's not one?"

Apr 28 2015, 5:26 am O)FaRTy1billion[MM] Post #2

👻 👾 👽 💪

This would be easy to do with probably any scripting language ... otherwise it'd be easy enough to throw together a simple C program for it.



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Apr 28 2015, 5:27 am NudeRaider Post #3

We can't explain the universe, just describe it; and we don't know whether our theories are true, we just know they're not wrong. >Harald Lesch

Well it should be pretty easy to program yourself. You just gotta know how the header looks like*. Because individual files have an EOF Marker, which can obviously not be inside the large file to separate the subfiles.

* And that's why there's probably no program that does that yet, because every file(type) has a different header, if it has one at all.
But I'm assuming you know what's inside the large file so it should be doable.




Apr 28 2015, 1:51 pm Roy Post #4

An artist's depiction of an Extended Unit Death

Yeah, it's a trivial implementation. You could go and download LinqPad and then throw a few C# statements into it:
Code
string text = File.ReadAllText(@"C:\path\to\file.txt");
string delimiter = "NEWFILE:";
string[] splits = Regex.Split(text, delimiter);
for (int i = 0; i < splits.Length; i++)
{
   if (!string.IsNullOrEmpty(splits[i]))
   {
       File.WriteAllText(@"C:\path\to\file_" + i + ".txt", splits[i]);
   }
}


But I went ahead and made a GUI for you in case you don't want to bother with all that. See attached. (Haven't tested it with non-text files, though.)

Attachments:
QuickSplit.exe
Hits: 1 Size: 10.5kb




Options
  Back to forum
Please log in to reply to this topic or to report it.
Members in this topic: None.
[2026-8-06. : 2:41 am]
Oh_Man -- i used to play TF2 competitive in that clan, and also was PR manager (ie: i wrote all the website posts)
[2026-8-06. : 2:41 am]
Oh_Man -- another fun fact iaguz actually joined the clan i was part of - Frenetic Array
[2026-8-06. : 2:40 am]
Symmetry -- Human memory is a fragile, fallible thing
[2026-8-06. : 2:39 am]
Oh_Man -- i realised all his shit was halluc and i wiped out his measly army of fake hallucs and he called GG - yeah thts wat actually happened damn false memory strikes again
[2026-8-06. : 2:38 am]
Oh_Man -- i was zerg, the toss guy did a bunch of hallucinates, and i was like, welp, i guess i'm dead, but i have that mindset of never giving up, so attacked him anyway, then tht was wen
[2026-8-06. : 2:38 am]
Oh_Man -- coz i was actually a zerg main, so wat ACTUALLY happened was a complete reverse of this
[2026-8-06. : 2:37 am]
Oh_Man -- i found an old comment of mine i actually think the idra thing over-ride my own memory
[2026-8-06. : 2:22 am]
Symmetry -- was it idra
[2026-8-06. : 1:52 am]
NudeRaider -- Oh_Man
Oh_Man shouted: and i went on to win the tournament, and a pair of steelseries headphones. i even reember how i won the final match - hallucinated a fck-tonne of units and my opponent thought i had way more than he did and GGed
classic
[2026-8-05. : 2:56 pm]
Oh_Man -- long story short - patience is a virtue!
Please log in to shout.


Members Online: l)ark_ssj9kevin