OnlyJava is your source for Blog Aggregation in the Java industry

The Trouble with Tribbles...

View This Blog Frequency: 0.0 posts / day

 

Tribblix image structural changes

 Mark As Read    

The Tribblix live ISO and related images are put together every so slightly differently in the latest m34 release.All along, there's been an overlay (think a group package) called base-iso that lists the packages that are present in the live image. On installation, this is augmented with a few extra packages that you would expect to be present in a...

Building up networks of zones on Tribblix

 Mark As Read    

With OpenSolaris and derivatives such as illumos, we gained the ability to build a whole IT infrastructure in a single box, using virtualized networking (crossbow) to build the underlying network and then attaching virtualized systems (zones) atop virtualized storage (zfs).Some of this was present in Solaris 10, but it didn't have crossbow so the n...

The SunOS JDK builder

 Mark As Read    

I've been building OpenJDK on Solaris and illumos for a while.This has been moderately successful; illumos distributions now have access to up to date LTS releases, most of which work well. (At least 11 and 17 are fine; 21 isn't quite right.)There are even some third-party collections of my patches, primarily for Solaris (as opposed to illumos) bui...

It seemed like a simple problem to fix

 Mark As Read    

While a bit under the weather last week, I decided to try and fix what at first glance appears to be a simple problem:need to ship the manpage with exaNow, exa is a modern file lister, and the package on Tribblix doesn't ship a man page. The reason for that, it turns out, is that there isn't a man page in the source, but you can generate one.To bui...

Keeping python modules in check

 Mark As Read    

Any operating system distribution - and Tribblix is no different - will have a bunch of packages for python modules.And one thing about python modules is that they tend to depend on other python modules. Sometimes a lot of python modules. Not only that, the dependency will be on a specific version - or range of versions - of particular modules.Whic...

When zfs was young

 Mark As Read    

On the Solaris 10 Platinum Beta program, one of the most exciting promised features was ZFS, the new file system.I was especially interested, given that I was in a data-heavy position at the time. The limits of UFS were painful, we had datasets into several terabytes already - and even the multiterabyte file system support that got added was actual...

SMF - part of the Solaris 10 legacy

 Mark As Read    

The Service Management Facility, or SMF, integrated extremely late in the Solaris 10 release cycle. We only got one or two beta builds to test, which seemed highly risky for such a key feature.So there was very little time to gather feedback from users. And something that central really can't be modified once it's released. It had to work first tim...

Static Site Generators

 Mark As Read    

The current Tribblix website is a bit of a hack. Technically it's using a static site generator - a simple home-grown script that constructs pages from a bit of content and boilerplate - but I wanted to be able to go a bit further.I looked at a few options - and there are really a huge number of them - such as Hugo and Zola. (Both are packaged for ...

Remnants of closed code in illumos

 Mark As Read    

One of the annoying issues with illumos has been the presence of a body of closed binaries - things that, for some reason or other, were never able to be open sourced as part of OpenSolaris.Generally the illumos project has had some success in replacing the closed pieces, but what's left isn't entirely zero.It took me a little while to work out wha...

Speed up zone installation with this one weird trick

 Mark As Read    

Sadly, the trick described below won't work in current releases of Solaris, or any of the illumos distributions. But back in the day, it was pretty helpful.In Solaris 10, we had sparse root zones - which shared /usr with the global zone, which not only saved space because you didn't need a copy of all the files, but creating them was much quicker b...

Modernizing scripts in Tribblix

 Mark As Read    

It's something I've been putting off for far too long, but it's about time to modernize all the shell scripts that Tribblix is built on.Part of the reason it's taken this long is the simple notion of, if it ain't broke, don't fix it.But some of the scripting was starting to look a bit ... old. Antiquated. Prehistoric, even.And there's a reason for ...

Retiring isaexec in Tribblix

 Mark As Read    

One of the slightly unusual features in illumos, and Solaris because that's where it came from, is isaexec.This facility allows you to have multiple implementations of a binary, and then isaexec will select the best one (for some definition of best).The full implementation allows you to select from a wide range of architectures. On my machine it'll...

Upgrading MATE on Tribblix

 Mark As Read    

I spent a little time yesterday updating MATE on Tribblix, to version 1.26.This was supposed to be part of the "next" release, but we had to make an out of sequence release for an illumos security issue, so everything gets pushed back a bit.Updating MATE is actually fairly easy, though. The components in MATE are largely decoupled, so can be update...

Maintaining old software with no sign of retirement

 Mark As Read    

There's a lot of really old software out there. Some of it has simply been abandoned; others have been replaced by new versions. But old software never really goes away, and we end up maintaining it.This is especially tricky when old software depends on other old software, and we have to support the entire dependency tree.There's always python2 and...

Zones, way back when

 Mark As Read    

The original big ticket feature in Solaris 10 was Zones, a simple virtualization technology that allowed a set of processes to be put aside in a separate namespace and be under the illusion that this was a separate computer system, all under a single shared kernel.As a result of this sleight of hand, you could connect to a zone using ssh (or, remem...

SPARC Tribblix m26 - what's in a number?

 Mark As Read    

I've just released Tribblix m26 for SPARC.The release history on SPARC looks a little odd - m20, m20.6, m22, m25.1, and now m26. Do these release versions mean anything?Up to and including m25.1, the illumos commit that the SPARC version was built from matched the corresponding x86 release. This is one reason there might be a gap in the release tra...

How I build the Tribblix AMIs

 Mark As Read    

I run Tribblix on AWS, and make some AMIs available. They're only available in London (eu-west-2) by default, because that's the only place where I use them, and it costs money to have them available in other regions. If you want to run them elsewhere, you can copy the AMI.It's not actually that difficult to create the AMIs, once you've got the han...

What, no fsck?

 Mark As Read    

There was a huge amount of resistance early on to the fact that zfs didn't have an fsck. Or, rather, a separate fsck.I recall being in Sun presentations introducing zfs and question after question was about how to repair zfs when it got corrupted.People were so used to shoddy file systems that were so badly implemented that a separate utility was n...

A decade of Tribblix

 Mark As Read    

I seem to have just missed the anniversary, but it turns out that Tribblix has existed for slightly over a decade.The initial blog post on Building Tribblix was published on October 24th, 2012. But the ISO image (milestone 0) was October 21st, and it looks like the packages were built on October 4th. So there's a bit of uncertainty about the actual...

TREASURE - The Remote Execution and Access Service Users Really Enjoy

 Mark As Read    

Many, many years ago I worked on a prototype of a software ecosystem I called TREASURE - The Remote Execution and Access Service Users Really Enjoy.At the time, I was running the infrastructure and application behind an international genomics service. The idea was that we could centrally manage all the software and data for genomic analysis, provid...

Tribblix for SPARC m25.1

 Mark As Read    

Following hot on the heels of the Tribblix Milestone 22 ISO for SPARC, it's possible to upgrade that to a newer version. The new version that's available is m25.1.(If the available versions look a bit random, that's because they are. Not every release on x86 was built for SPARC, and not all of the ones that were actually worked properly. So we have...

Tribblix for SPARC m22 ISO now available

 Mark As Read    

I've made available a newer ISO image for Tribblix on SPARC.This is an m22 ISO. So it's actually relatively old compared to the mainstream x86 release.I actually had a number of random SPARC ISO images, but for a while I've had no way of testing any of them. (And many of the problems with the SPARC ISOs in general is because I had no real way of te...

DevOps as a HR problem

 Mark As Read    

I wrote about one way in which HR and IT can operate more closely, but there's another interaction between IT and HR that might not be so benign.DevOps is ultimately about breaking down silos in IT (indeed, my definition of DevOps is as a cultural structure where teams work together to meet the needs of the business rather than competing against ea...

On the intersection between IT and HR

 Mark As Read    

A while ago I mentioned The three strands of Information Technology, and how this was split into an internal-facing component (IT for the business, IT for the employee) and external-facing (IT for the customer).In a pure technology company, there's quite a mismatch, with the customer-facing component being dominant and the internal-facing parts bei...

Tribblix m28, Digital Ocean, and vioscsi

 Mark As Read    

A while ago, I wrote about deploying Tribblix on Digital Ocean.The good news is that the same process works flawlessly with the recently released m28 Tribblix release.If you recall from the original article, adding an additional storage volume didn't work. But, we now have a vioscsi driver, so has the situation improved?Yes!All I did was select an ...

Tribblix and static networking on AWS

 Mark As Read    

I've just made available the m27 AMIs for Tribblix. As usual, these are just available in London (eu-west-2).One thing I've noticed repeatedly while running illumos on AWS is that network stability isn't great. The instance will occasionally drop off the network and stubbornly refuse to reclaim its IP address even if you reboot it. It's not just Tr...

Cleaning up the Java illumos port

 Mark As Read    

This was originally a twitter thread, this is a more permanent expanded version.When support for Solaris and SPARC was removed from Java, the code that was removed fell into a number of distinct classes, not all of which are equally valuable.Solaris platform supportFirst, there's the support for Solaris (and thus illumos) as an operating system (th...

On password policies in the 21st century

 Mark As Read    

One of the scourges of corporate life was the forced monthly password change. As anyone who understands security will know, this was always a terrible idea - it leads to a culture of passwords that are weak, formulaic, and written down.Another, more widespread scourge, is the use of devious complexity requirements.Fortunately, the world is changing...

The datacentre business seems to be very much alive

 Mark As Read    

Last week I went to Cloud Expo Europe at ExCeL.(Yes, there was a tube strike. No, that didn't affect me much. Had to walk from London Bridge Station to Tower Gateway to get to the DLR, but walking past HMS Belfast, Tower Bridge, and the Tower of London isn't such an imposition.)Now, "Cloud Expo" is the umbrella event. There are a number of co-locat...

Tribblix updates and https

 Mark As Read    

One good thing to have happened recently is the rise of Let's Encrypt, bringing https to all websites without all the hassle you previously had to go through to get a certificate.One not quite so good event recently was the switch by Let's Encrypt to certificates signed by their own ISRG X1 root, and more excitingly the expiry of the prior DST Root...

Inside zone installation

 Mark As Read    

How do zones actually get put together on Solaris and illumos? Specifically, how does a zone get installed? There are various type of zones. The nomenclature here is a brand. A zone's brand defines how it gets installed and managed and its properties. Often, this is mapped to a zone template which is the default configuration for a zone of that typ...

Are software ecosystems a good thing?

 Mark As Read    

One way to judge the health or strength of a product might be to look at the ecosystem surrounding that product. But is this diagnostic? Note that there are several concepts here that are similar to the ecosystem. I'm not referring to the community, those people who might use or support the product. Nor am I talking about a marketplace, which is a ...

The three strands of Information Technology

 Mark As Read    

How are IT departments structured? I've seen a variety of ways to do this. It depends on the individual business, but over the years I've come up with a way to think about this.When thinking about Information Technology (IT), it naturally splits into 3 separate strands:IT for the businessThis is the provision of facilities for HR, Finance, Sales, a...

The cost of cloud

 Mark As Read    

Putting your IT infrastructure into the cloud seems to be the "in" thing. It's been around for a while, of course. And, like most things related to IT, there are tradeoffs to be made.My rough estimate is that the unit cost of provisioning a service on AWS is about 3 times that of a competent IT organization providing a similar service in house. Oth...

Keeping Java alive on illumos

 Mark As Read    

Back in 2019, a new JEP (JDK Enhancement Proposal) appeared. JEP 362: Deprecate the Solaris and SPARC PortsOf course, for those of us running Solaris or illumos (which is the same platform as far as Java is concerned), this was a big deal. Losing support for a major language on the platform was potentially a problem.The stated reason for removal wa...

Running Tribblix on Digital Ocean

 Mark As Read    

A relatively recent feature offered by Digital Ocean is the ability to deploy your own custom image. So, can I deploy a Tribblix image to Digital Ocean?Short answer: Yes!For the process, read on.I'm using Bhyve to create the image. This is a slight variation on the Installing Tribblix in Bhyve on Tribblix procedure.The basic process looks like this...

Installing Tribblix in Bhyve on Tribblix

 Mark As Read    

One of the big new features recently added to illumos is the Bhyve hypervisor. Rather that the shared-kernel application-level virtualization offered by zones, think of something like VirtualBox, KVM, or Qemu.One of the things that I am using Bhyve for is to test the Tribblix ISO images and the installer. This allowed me to shrink the installer foo...

Tweaking the Tribblix ISO

 Mark As Read    

For the latest release, I've made a couple of tweaks to the Tribblix ISO image.The first is that it's now a hybrid ISO. So you should be able to write it (simply dd it) to a USB stick and use that to boot. I've never managed to both create and test a usb image, so this should be a win.The hybrid ISO also boots under bhyve, which the old ISO never d...

Running Eclipse on current illumos

 Mark As Read    

You can run a slightly old version of Eclipse on illumos. The download is here.Later Eclipse (and SWT) versions didn't have Solaris support. Or any unix variant such AIX or HPUX either, or certain hardware platforms, come to that.However, if you try and run that eclipse on current Tribblix or OpenIndiana, you'll find it doesn't work and you get a J...

Installing OmniOS on Vultr with iPXE

 Mark As Read    

A while ago, I wrote about booting Tribblix on Vultr using iPXE.Naturally, the question arises - is this possible for other illumos distributions, like OmniOS?First, though, a note about why this might be interesting. Imagine I have some servers in a remote datacenter, and I need to install an OS. Most servers have some sort of remote managamenet c...

Adventures in Server Rooms

 Mark As Read    

I'm a fan of the cloud. Honest. Providing someone else is paying for it, that is, given how ridiculously expensive it is.But running stuff in the cloud is a whole lot easier for me. Someone else fixing hardware and infrastructure is a big win. No more driving to the datacenter at 3 in the morning. No more wandering into a room that's baking at 70C ...

Tribblix on Vultr with Block Storage

 Mark As Read    

I wrote a while back about installing Tribblix on Vultr using iPXE.That all still works perfectly with the m23.2 release. And it's pretty quick too. It's even quicker on the new "High Frequency" servers, that appear to be a 3.8GHz Skylake chip and NVME storage.One of the snags with many of the smaller cloud providers is that they don't necessarily ...

The state of Tribblix, 2020

 Mark As Read    

It's been a funny year, has 2020.But amongst all this, work on Tribblix continues.I released milestone 22 back in March. That was a fairly long time in the making, as the previous relase was 9 months earlier. Part of the reason for the lengthy delay was that there wasn't all that much reason for a new release - there are a lot of updated packages, ...

Solaris 10 zones on Tribblix

 Mark As Read    

One of the interesting capabilities of Solaris zones was the ability to run older versions of Solaris than that in the global zone. Marketing managed to mangle this into Containers, and it was supported for Solaris 8 and Solaris 9.I used this extensively on one project, to lift a whole datacenter of ancient (yes, really ancient) Sun servers into zo...

Customizing EC2 instance storage and networking with the AWS CLI

 Mark As Read    

I use AWS to run illumos quite a bit, either with Tribblix or OmniOS.Creating EC2 instances with the console is fine for one-offs, but gets a bit tedious. So using the AWS CLI offers a better route, with the ec2 run-instances command.Yes. there are things like templates and terraform and all sorts of other options. For whatever reason, they don't w...

Creating illumos packages for Tribblix

 Mark As Read    

In the prior article in this series, I discussed how to build illumos-gate (and it applies to illumos-omnios too), using a Tribblix AMI on AWS.After that, you'll have two directories of interest under illumos-gate.The proto area, specifically proto/root_i386, that is a fully installed copy of illumos.Under packages, an on-disk IPS package respoitor...

Notes on web servers and client certificates

 Mark As Read    

With https, web servers have digital certificates to encrypt and authenticate traffic.Web servers can also require clients to present a valid certificate, which could be used for authentication and identity.I've recently had the misfortune to end up delving into this, so here are some notes on diagnosing and testing this from a client perspective. ...

A teeny bug in jkstat char handling

 Mark As Read    

While messing about with illuminate, I noticed an interesting oddity in the disk display:See on the end of the product string is that "Revision"? That shouldn't be there, and iostat -En doesn't show it. This comes from my JKstat code, so where have I gone wrong?This comes from the sderr kstat, which is a named kstat of the device_error class.A name...

Setting up replicated PostgreSQL on Tribblix

 Mark As Read    

When you're building systems, it's nice to build in some level of resilience. After all, failures will happen.So, we use PostgreSQL quite a bit. We actually use a fairly traditional replication setup - the whole of the data is pushed using zfs send and receive to a second system. Problem at the source? We just turn on the DR site, and we're done.On...

Setting up an etcd cluster on Tribblix

 Mark As Read    

Using etcd to store configuration data is a common pattern, so how might you set up an etcd cluster on Tribblix?Updated: With current etcd, you may need to add the --enable-v2=true flag, as shown below. For example, Patroni requires v2. I'll start by creating 3 zones to create a 3-node cluster. For testing these could all be on the same physical sy...

Java
Welcome!
OnlyJava aggregates blogs for the Java industry.
Custom Feeds
Add any RSS feed to the information you read daily.
Blocked Feeds
Block feeds to remove blogs you’re not interested in.
Account Settings
Customize the site by adding or removing feeds.

About Us

OnlyJava is your source for all your Java news.

Have a Suggestion for Us?
Know of a Java blog that we're missing? Let us know!

Share OnlyJava.com