How can I easily compress and decompress Strings to/from byte arrays?

Question

I have some strings that are roughly 10K characters each. There is plenty of repetition in them. They are serialized JSON objects. I'd like to easily compress them into a byte array, and uncompress them from a byte array.

How can I most easily do this? I'm looking for methods so I can do the following:

String original = "....long string here with 10K characters...";
byte[] compressed = StringCompressor.compress(original);
String decompressed = StringCompressor.decompress(compressed);
assert(original.equals(decompressed);

I would use InflatorInputStream/DeflatorOutputStream with ByteArrayInput/OutputStream. — Peter Lawrey
– Peter Lawrey, Commented May 13, 2012 at 14:11
There's an easy-to-use 'zip' class out there... edit - it is here docs.oracle.com/javase/6/docs/api/java/util/zip/… and seems to use the classes @peter mentioned. — Tony Ennis
– Tony Ennis, Commented May 13, 2012 at 14:11
How about this? stackoverflow.com/questions/3649485/how-to-compress-a-string — Mikita Belahlazau
– Mikita Belahlazau, Commented May 13, 2012 at 14:13
just using String and byte[] this can't be more than a 10-15 line method, assuming the JSON is all ascii. If you have to do something utf-8 ish, add 10 more lines... — wholerabbit
– wholerabbit, Commented May 13, 2012 at 14:13

Peter Lawrey · Accepted Answer · 2012-05-13 14:31:43Z

30

You can try

enum StringCompressor {
    ;
    public static byte[] compress(String text) {
        ByteArrayOutputStream baos = new ByteArrayOutputStream();
        try {
            OutputStream out = new DeflaterOutputStream(baos);
            out.write(text.getBytes("UTF-8"));
            out.close();
        } catch (IOException e) {
            throw new AssertionError(e);
        }
        return baos.toByteArray();
    }

    public static String decompress(byte[] bytes) {
        InputStream in = new InflaterInputStream(new ByteArrayInputStream(bytes));
        ByteArrayOutputStream baos = new ByteArrayOutputStream();
        try {
            byte[] buffer = new byte[8192];
            int len;
            while((len = in.read(buffer))>0)
                baos.write(buffer, 0, len);
            return new String(baos.toByteArray(), "UTF-8");
        } catch (IOException e) {
            throw new AssertionError(e);
        }
    }
}

edited May 13, 2012 at 14:31

answered May 13, 2012 at 14:22

Peter Lawrey

535k83 gold badges770 silver badges1.2k bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

black panda Over a year ago

Hello, why do you use enum instead of class here? Is it to prove a point?

Steve McLeod Over a year ago

Some people like to use enum classes as a way to implement singletons or static-only classes. Recommended by Joshua Bloch, writer of Effective Java.

Peter Lawrey Over a year ago

Its to say there no instances of this class allowed.

Matthieu Over a year ago

Note to myself (and some others who might have wanted to achieve the same): you can't use that method to compress a String into another String, as the charset will mess up the byte content (see stackoverflow.com/questions/2544965/…).

Peter Lawrey Over a year ago

@Matthieu You can use ISO-8859-1 encoding to store bytes in a String without loss.

|

Ray Hulha · Accepted Answer · 2017-02-17 06:30:12Z

5

Peter Lawrey's answer can be improved a bit using this less complex code for the decompress function

    ByteArrayOutputStream baos = new ByteArrayOutputStream();
    try {
        OutputStream out = new InflaterOutputStream(baos);
        out.write(bytes);
        out.close();
        return new String(baos.toByteArray(), "UTF-8");
    } catch (IOException e) {
        throw new AssertionError(e);
    }

answered Feb 17, 2017 at 6:30

Ray Hulha

11.3k5 gold badges57 silver badges57 bronze badges

Comments

lithedream · Accepted Answer · 2017-06-16 19:08:33Z

1

I made a library to solve the problem of compressing generic Strings (expecially short ones). It tries to compress the String using various algorithms (plain utf-8, 5bit encoding for latin letters, huffman encoding, gzip for long Strings) and chooses the one with the shortest result (in the worst case, it will choose the utf-8 encoding, so that you never risk to lose space).

I hope it may be useful, here's the link https://github.com/lithedream/lithestring

EDIT: I realized that your Strings are always "long", my library defaults on gzip for those sizes, I fear I cannot do better for you.

edited Jun 16, 2017 at 19:08

answered Jun 16, 2017 at 19:00

lithedream

114 bronze badges

1 Comment

Lluis Martinez Over a year ago

Why a library if the standard API already solves the problem?

Collectives™ on Stack Overflow

How can I easily compress and decompress Strings to/from byte arrays?

3 Answers 3

7 Comments

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

7 Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related