This bug appears to have been reported against 'rawhide' during the Fedora 22 development cycle.
Changing version to '22'.

More information and reason for this action is here:
https://fedoraproject.org/wiki/Fedora_Program_Management/HouseKeeping/Fedora22

This package has changed ownership in the Fedora Package Database.  Reassigning to the new owner of this component.

My best understanding of the texlive spec file doesn't reflect this. The arara files are simply unpacked. Please look at rawhide and reopen if this is still happening and point to the specifics.

Still present in rawhide:

$ rpm2cpio texlive-arara-svn29762.3.0-5.fc24.noarch.rpm | cpio -i --make
$ jar tf ./usr/share/texlive/texmf-dist/scripts/arara/arara.jar | grep mvel.*class | head
org/mvel2/asm/AnnotationVisitor.class
org/mvel2/asm/AnnotationWriter.class
org/mvel2/asm/Attribute.class
org/mvel2/asm/ByteVector.class

It looks like several other Java libraries are copied in this way.

Fedora 22 changed to end-of-life (EOL) status on 2016-07-19. Fedora 22 is
no longer maintained, which means that it will not receive any further
security or bug fix updates. As a result we are closing this bug.

If you can reproduce this bug against a currently maintained version of
Fedora please feel free to reopen this bug against that version. If you
are unable to reopen this bug, please file a new report against the
current release. If you experience problems, please add a comment to this
bug.

Thank you for reporting this bug and we are sorry it could not be fixed.

perl-BibTeX-Parser-0.69-1.fc25, perl-LaTeX-ToUnicode-0.04-1.fc25, texlive-2016-5.20160520.fc25 has been pushed to the Fedora 25 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-50a2bc7997

perl-BibTeX-Parser-0.69-1.fc25, perl-LaTeX-ToUnicode-0.04-1.fc25, texlive-2016-6.20160520.fc25 has been pushed to the Fedora 25 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-50a2bc7997

This is not correct:

Requires: texlive-arara-bin
Provides: bundled(slf4j)
Provides: bundled(apache-commons-collections)
Provides: bundled(apache-commons-exec)
Provides: bundled(apache-commons-lang3)
Provides: bundled(apache-commons-cli)
Provides: bundled(mvel2)
Provides: bundled(snakeyaml)
Provides: bunbled(logback)

The bundling happens in texlive-arara (without -bin).

Umm.... no, I think that is correct.

%package arara
Provides: tex-arara = %{tl_version}
License: BSD
Summary: Automation of LaTeX compilation
Version: svn29762.3.0
Release: %{tl_noarch_release}.1
BuildArch: noarch
Requires: texlive-base
Requires: texlive-kpathsea-bin, tex-kpathsea
Requires: texlive-arara-bin
Provides: bundled(slf4j)
Provides: bundled(apache-commons-collections)
Provides: bundled(apache-commons-exec)
Provides: bundled(apache-commons-lang3)
Provides: bundled(apache-commons-cli)
Provides: bundled(mvel2)
Provides: bundled(snakeyaml)
Provides: bunbled(logback)

Those provides are not on arara-doc or arara-bin, just arara (where the jar file is).

Right, sorry.

perl-BibTeX-Parser-0.69-1.fc25, perl-LaTeX-ToUnicode-0.04-1.fc25, texlive-2016-7.20160520.fc25 has been pushed to the Fedora 25 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-50a2bc7997

perl-BibTeX-Parser-0.69-1.fc25, perl-LaTeX-ToUnicode-0.04-1.fc25, texlive-2016-17.20160520.fc25 has been pushed to the Fedora 25 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2016-50a2bc7997

perl-BibTeX-Parser-0.69-1.fc25, perl-LaTeX-ToUnicode-0.04-1.fc25, texlive-2016-17.20160520.fc25 has been pushed to the Fedora 25 stable repository. If problems still persist, please make note of it in this bug report.