Skip to content
Snippets Groups Projects
  1. Feb 03, 2010
  2. Jan 23, 2010
    • Shawn Pearce's avatar
      Correct bundle, provider names to be consistent · 0238a21b
      Shawn Pearce authored
      
      Technically our project name is "JGit", not "Java Git".  In fact
      there is already another project called "JavaGit" (no space) that we
      don't want to become confused with.  Ensure we always call ourselves
      "JGit" in user visible assets, like the bundle name.
      
      Other Eclipse products list their provider as "Eclipse.org",
      not "eclipse.org".  So list ourselves that way in all of our
      plugin.properties files.
      
      Change-Id: Ibcea1cd6dda2af757a8584099619fc23b7779a84
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      0238a21b
    • Shawn Pearce's avatar
      Rewrite reference handling to be abstract and accurate · 01b5392c
      Shawn Pearce authored
      
      This commit actually does three major changes to the way references
      are handled within JGit.  Unfortunately they were easier to do as
      a single massive commit than to break them up into smaller units.
      
      Disambiguate symbolic references:
      ---------------------------------
      
        Reporting a symbolic reference such as HEAD as though it were
        any other normal reference like refs/heads/master causes subtle
        programming errors.  We have been bitten by this error on several
        occasions, as have some downstream applications written by myself.
      
        Instead of reporting HEAD as a reference whose name differs from
        its "original name", report it as an actual SymbolicRef object
        that the application can test the type and examine the target of.
      
        With this change, Ref is now an abstract type with different
        subclasses for the different types.
      
        In the classical example of "HEAD" being a symbolic reference to
        branch "refs/heads/master", the Repository.getAllRefs() method
        will now return:
      
            Map<String, Ref> all = repository.getAllRefs();
            SymbolicRef HEAD = (SymbolicRef) all.get("HEAD");
            ObjectIdRef master = (ObjectIdRef) all.get("refs/heads/master");
      
            assertSame(master,               HEAD.getTarget());
            assertSame(master.getObjectId(), HEAD.getObjectId());
      
            assertEquals("HEAD",              HEAD.getName());
            assertEquals("refs/heads/master", master.getName());
      
        A nice side-effect of this change is the storage type of the
        symbolic reference is no longer ambiguous with the storge type
        of the underlying reference it targets.  In the above example,
        if master was only available in the packed-refs file, then the
        following is also true:
      
            assertSame(Ref.Storage.LOOSE,  HEAD.getStorage());
            assertSame(Ref.Storage.PACKED, master.getStorage());
      
        (Prior to this change we returned the ambiguous storage of
         LOOSE_PACKED for HEAD, which was confusing since it wasn't
         actually true on disk).
      
        Another nice side-effect of this change is all intermediate
        symbolic references are preserved, and are therefore visible
        to the application when they walk the target chain.  We can
        now correctly inspect chains of symbolic references.
      
        As a result of this change the Ref.getOrigName() method has been
        removed from the API.  Applications should identify a symbolic
        reference by testing for isSymbolic() and not by using an arcane
        string comparsion between properties.
      
      Abstract the RefDatabase storage:
      ---------------------------------
      
        RefDatabase is now abstract, similar to ObjectDatabase, and a
        new concrete implementation called RefDirectory is used for the
        traditional on-disk storage layout.  In the future we plan to
        support additional implementations, such as a pure in-memory
        RefDatabase for unit testing purposes.
      
      Optimize RefDirectory:
      ----------------------
      
        The implementation of the in-memory reference cache, reading, and
        update routines has been completely rewritten.  Much of the code
        was heavily borrowed or cribbed from the prior implementation,
        so copyright notices have been left intact as much as possible.
      
        The RefDirectory cache no longer confuses symbolic references
        with normal references.  This permits the cache to resolve the
        value of a symbolic reference as late as possible, ensuring it
        is always current, without needing to maintain reverse pointers.
      
        The cache is now 2 sorted RefLists, rather than 3 HashMaps.
        Using sorted lists allows the implementation to reduce the
        in-memory footprint when storing many refs.  Using specialized
        types for the elements allows the code to avoid additional map
        lookups for auxiliary stat information.
      
        To improve scan time during getRefs(), the lists are returned via
        a copy-on-write contract.  Most callers of getRefs() do not modify
        the returned collections, so the copy-on-write semantics improves
        access on repositories with a large number of packed references.
      
        Iterator traversals of the returned Map<String,Ref> are performed
        using a simple merge-join of the two cache lists, ensuring we can
        perform the entire traversal in linear time as a function of the
        number of references: O(PackedRefs + LooseRefs).
      
        Scans of the loose reference space to update the cache run in
        O(LooseRefs log LooseRefs) time, as the directory contents
        are sorted before being merged against the in-memory cache.
        Since the majority of stable references are kept packed, there
        typically are only a handful of reference names to be sorted,
        so the sorting cost should not be very high.
      
        Locking is reduced during getRefs() by taking advantage of the
        copy-on-write semantics of the improved cache data structure.
        This permits concurrent readers to pull back references without
        blocking each other.  If there is contention updating the cache
        during a scan, one or more updates are simply skipped and will
        get picked up again in a future scan.
      
        Writing to the $GIT_DIR/packed-refs during reference delete is
        now fully atomic.  The file is locked, reparsed fresh, and written
        back out if a change is necessary.  This avoids all race conditions
        with concurrent external updates of the packed-refs file.
      
        The RefLogWriter class has been fully folded into RefDirectory
        and is therefore deleted.  Maintaining the reference's log is
        the responsiblity of the database implementation, and not all
        implementations will use java.io for access.
      
        Future work still remains to be done to abstract the ReflogReader
        class away from local disk IO.
      
      Change-Id: I26b9287c45a4b2d2be35ba2849daa316f5eec85d
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      01b5392c
    • Matthias Sohn's avatar
      Use build timestamp as OSGi version qualifier · 407fe631
      Matthias Sohn authored
      
      Translate the version qualifier using maven-antrun-plugin since we want
      manifest-first and currently cannot rely on Tycho for the JGit build.
      
      Introduce property for Eclipse p2 repository to enable builds against
      other Eclipse versions.
      
      Change-Id: I62c4e77ae91fe17f56c5a5338d53828d4e225395
      Signed-off-by: default avatarMatthias Sohn <matthias.sohn@sap.com>
      407fe631
  3. Jan 12, 2010
    • Shawn Pearce's avatar
      Finish removing Apache Felix maven-bundle-plugin · 20b4d474
      Shawn Pearce authored
      
      Since Robin reverted using the maven-bundle-plugin to produce the
      OSGi manifest, there is no reason for us to reference it from our
      build process anymore.
      
      Also, when Robin reverted the to the Eclipse way of doing things,
      we failed to update the ignore files to ignore our generated files
      but not ignore our tracked .classpath.
      
      Finally, we cannot delete the MANIFEST.MF file during a Maven build,
      as this is once again a source file.
      
      Change-Id: I53f77f2002cb4285f728968829560e835651e188
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      20b4d474
  4. Jan 10, 2010
  5. Dec 28, 2009
    • Shawn Pearce's avatar
      Switch build to Apache Felix maven-bundle-plugin · fc5fc70e
      Shawn Pearce authored
      
      Tycho isn't production ready for projects like JGit to be using as
      their primary build driver.  Some problems we ran into with Tycho
      0.6.0 that are preventing us from using it are:
      
       * Tycho can't run offline
      
         The P2 artifact resolver cannot perform its work offline.  If the
         build system has no network connection, it cannot compile a
         project through Tycho.  This is insane for a distributed version
         control system where developers are used to being offline during
         development and local testing.
      
       * Magic state in ~/.m2/repository/.meta/p2-metadata.properties
      
         Earlier iterations of this patch tried to use a hybrid build,
         where Tycho was only used for the Eclipse specific feature and P2
         update site, and maven-bundle-plugin was used for the other code.
         This build seemed to work, but only due to magic Tycho specific
         state held in my local home directory.  This means builds are not
         consistently repeatable across systems, and lead me to believe
         I had a valid build, when in fact I did not.
      
       * Manifest-first build produces incomplete POMs
      
         The POM created by the manifest-first build format does not
         contain the dependency chain, leading a downstream consumer to
         not import the runtime dependencies necessary to execute the
         bundle it has imported.  In JGit's case, this means JSch isn't
         included in our dependency chain.
      
       * Manifest-first build produces POMs unreadable by Maven 2.x
      
         JGit has existing application consumers who are relying on
         Maven 2.x builds.  Forcing them to step up to an alpha release
         of Maven 3 is simply unacceptable.
      
       * OSGi bundle export data management is tedious
      
         Editing each of our pom.xml files to mark a new release is
         difficult enough as it is.  Editing every MANIFEST.MF file to
         list our exported packages and their current version number is
         something a machine should do, not a human.  Yet the Tycho OSGi
         way unfortunately demands that a human do this work.
      
       * OSGi bundle import data management is tedious
      
         There isn't a way in the MANIFEST.MF file format to reuse the
         same version tags across all of our imports, but we want to have
         a consistent view of our dependencies when we compile JGit.
      
      After wasting more than 2 full days trying to get Tycho to work,
      I've decided its a lost cause right now.  We need to be chasing down
      bugs and critical features, not trying to bridge the gap between
      the stable Maven repository format and the undocumented P2 format
      used only by Eclipse.
      
      So, switch the build to use Apache Felix's maven-bundle-plugin.
      
      This is the same plugin Jetty uses to produce their OSGi bundle
      manifests, and is the same plugin used by the Apache Felix project,
      which is an open-source OSGi runtime.  It has a reasonable number
      of folks using it for production builds, and is running on top of
      the stable Maven 2.x code base.
      
      With this switch we get automatically generated MANIFEST.MF files
      based on reasonably sane default rules, which reduces the amount
      of things we have to maintain by hand.  When necessary, we can add
      a few lines of XML to our POMs to tweak the output.
      
      Our build artifacts are still fully compatible with Maven 2.x, so
      any downstream consumers are still able to use our build products,
      without stepping up to Maven 3.x.  Our artifacts are also valid as
      OSGi bundles, provided they are organized on disk into a repository
      that the runtime can read.
      
      With maven-bundle-plugin the build runs offline, as much as Maven
      2.x is able to run offline anyway, so we're able to return to a
      distributed development environment again.
      
      By generating MANIFEST.MF at the top level of each project (and
      therefore outside of the target directory), we're still compatible
      with Eclipse's PDE tooling.  Our projects can be imported as standard
      Maven projects using the m2eclipse plugin, but the PDE will think
      they are vaild plugins and make them available for plugin builds,
      or while debugging another workbench.
      
      This change also completely removes Tycho from the build.
      
      Unfortunately, Tycho 0.6.0's pom-first dependency resolver is broken
      when resolving a pom-first plugin bundle through a manifest-first
      feature package, so bundle org.eclipse.jgit can't be resolved,
      even though it might actually exist in the local Maven repository.
      
      Rather than fight with Tycho any further, I'm just declaring it
      plugina-non-grata and ripping it out of the build.
      
      Since there are very few tools to build a P2 format repository, and
      no documentation on how to create one without running the Eclipse
      UI manually by poking buttons, I'm declaring that we are not going
      to produce a P2 update site from our automated builds.
      
      Change-Id: If7938a86fb0cc8e25099028d832dbd38110b9124
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      fc5fc70e
  6. Nov 03, 2009
    • Shawn Pearce's avatar
      Move AWT based SSH authenticator to ui bundle · 27a497f8
      Shawn Pearce authored
      
      This way SWT based applications don't wind up loading this AWT
      based code when using SSH.
      
      Change-Id: I9080f3dd029c2a087e6b687480018997cc5c5d23
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      27a497f8
    • Shawn Pearce's avatar
      Refactor the cached Authenticator data out of AwtAuthenticator · 91080357
      Shawn Pearce authored
      
      This makes it easier to swap out authenticator implementations and
      yet still rely upon being able to configure at least one Authenticator
      instance in the JVM and program it with data obtained from outside
      of the user interface.
      
      Change-Id: I8c1a0eb8acee1d306f4c3b40a790b7fa0c3abb70
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      91080357
    • Shawn Pearce's avatar
      Refactor our Maven build to be modular · dad52baa
      Shawn Pearce authored
      
      Drop our simple and stupid jgit.sh and instead rely upon Maven
      for the command line based build.  Maven is relatively simple to
      download and install, and doesn't require the entire Eclipse IDE.
      
      To avoid too much refactoring of the current code we reuse the
      existing src/ directory within each plugin, and treat each of
      the existing OSGI bundles as one Maven artifact.
      
      The command line wrapper jgit.sh no longer works in the uncompiled
      state, as we don't know where to obtain our JSch or args4j from.
      Developers will now need to compile it with `mvn package`, or run
      our Main class from within an IDE which has the proper classpath.
      
      Bug: 291265
      Change-Id: I355e95fa92fa7502651091d2b651be6917a26805
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      dad52baa
  7. Oct 31, 2009
    • Mykola Nikishov's avatar
      Move AWT UI code to new org.eclipse.jgit.ui bundle · cf2edb65
      Mykola Nikishov authored
      This new UI bundle contains the org.eclipse.jgit.awtui package,
      which was moved out of the org.eclipse.jgit bundle.
      
      org.eclipse.jgit.pgm depends on org.eclipse.jgit.ui, so we need
      to update the classpath and make_jgit.sh to include it.
      
      This move takes the awtui classes out of the Maven build, which
      means we are no longer able to distribute these classes to our
      downstream Maven customers.  The entire Maven package structure
      needs to be overhauled so that Eclipse bundle matches 1:1 with the
      Maven artifact.
      
      Bug: https://bugs.eclipse.org/291124
      
      
      Change-Id: Ibf1a9968387e3d11fdce54592f710ec4cc7f1ddb
      Signed-off-by: default avatarMykola Nikishov <mn@mn.com.ua>
      Signed-off-by: default avatarShawn O. Pearce <spearce@spearce.org>
      cf2edb65
Loading