My Vagrant fork of Oracle Fleet Patching and Provisioning (FPP)
I have been asked to read about Oracle database fleet management at work but the turnoff was that it relied entirely on OEM. Aggregating both functionalities makes provisioning, in my opinion, cumbersome and unattractive for shops that only want to manage the fleet. Luckily for me, I got acquainted with an even better framework that’s dedicated to managing the provisioning and patching of fleets of targets (DBs & Grids). It’s called Fleet Provisioning and Patching (formerly Rapid Home Provisioning).
Keep my GitHub repo close before reading further: https://github.com/brokedba/OracleFPP
- Seamless provisioning, patching, and upgrading
- Agile (less code, out of place deployment, Zero downtime support ie: GoldenGate/DG)
- Increases automation and less heavy to implement (reduced technical debt)
- Doesn’t rely on OEM (only Grid) nor require an EM license (free with RAC/[One-node])
To my surprise, I assimilated more in an hour of reading FPP than days spent digging on Database fleet Documentation.
When Oracle FPP meets Vagrant\VirtualBox
By the end of 2019, Oracle did the perfect move by making FPP framework accessible to the community through VirtualBox. A new vagrant build was added to their vagrant projects in Github and now, with a simple “vagrant up” you can try FPP on your own laptop. The build was created by Ruggero Citton from RACPack/MAA team and allows either of the below setups:
- Set up an Oracle FPP Server and (Optional) FPP Target on host-only (private) VirtualBox network
- Set up an Oracle FPP Server (only) on a public network (to be used with targets on your own network).
Note: Besides VirtualBox, the build also includes support for libvirt KVM provider
What’s in it for you with my fork
I was super excited to test FPP using my favourite DevOps tools, so I deployed the lab and succeeded to run few tasks like importing 19c database and grid software images, creating working copies, and adding a database using rhctl command. But what if my environment has only 12c Oracle homes? how could I leverage this FPP lab to manage a 12c fleet?
For this reason and after few exchanges in GitHub, I decided to create a GitHub fork build that includes scenarios proper to 12c Oracle Homes where one could
- Import an image from an existing 12c database home to the FPP server and do some patching tests
- Upgrade from an existing 12 target DB home to a 19c working copy
- Anything else that can be tried with a 12c database home using FPP
Although all of the content is available on Github’s Read.me Page, I will try to share the relevant part in this article to add more context to the reader.
1. Disk space requirement
- Software zipped binaries for 19c Grid, 19c & 12c Database under “./ORCL_software”: ~8.3 Gb.
- FPP server : 2 OS vdisks (should be 1 but original vagrantfile has 2) => actual size : ~2 Gb (max 50)
- FPP server : Grid Infrastructure on fpps_u01 vdisk => actual size : 12GB (max 100)
- FPP server : 6x shared asm vdisks => actual size : ~40GB (max 60)
Below storage needed if host 2 and 12c database are deployed
- FPP target : 2 OS vdisks (should be 1) => actual size : ~6 Gb (max 50)
- FPP target : fppc_u01 vdisk for working copies => actual size : ~13GB (max 100)
- FPP target : I added fppc_u02 vdisk for existing 12 database oradata => actual size : ~5GB (max 100)
Total space with an existing 12c database and 19c working copy in the FPP target, along with two images on the FPP server is ~78GB
- The minimum required is 18GB (12 for the FPP server and 6 for the FPP target). Consider 12 only if the target is not deployed.
3. The expecting Oracle software
You can customize the environment by editing the parameters in the configuration file:
"vagrant.yml“ but there is another file that holds the core configuration of our vagrant build which is “Vagrantfile“
What I changed
- I added 2 scripts that will deploy a 12c database if db_deploy=true in the FPP target
Adapted the VagrantFile to add a disk for the 12c datafiles (oradata) in the FPP target
– The following is a sample of vagrant.yml and its customizable parameters (default)
Note: All host2 parameters that come after “deploy: true” were added by me in order to allow an optional DB deployment
– If you scroll further, you will see two remaining sections that contain few shared network and FPP environment parameters
All descriptions can be found >>here
Clone my repository : git clone https://github.com/brokedba/OracleFPP.git
Download and move the binaries under clone_path/OracleFPP/ORCL_software
cd into the cloned directory : cd clone_path/OracleFPP
Run “vagrant up” and let the magic happen
Log into either FPP-server [vagrant ssh host1 ] or FPP-target [vagrant ssh host2]
Now that the vagrant build is deployed you can start running few commands depending on the scenario you choose.
Having a limited resource you may want setup the following JAVA env variables for grid user before rhpctl commands executions:
export JVM_ARGS="-Xms512m -Xmx512m" and export _JAVA_OPTIONS="-XX:ParallelGCThreads=2"
Here are few tasks I tried myself :
1. Import Database image
[grid@fpp-S]$ rhpctl import image -image db_19300 -imagetype ORACLEDBSOFTWARE -zip /vagrant/ORCL_software/LINUX.X64_193000_db_home.zip QUERY IMAGE ============ [grid@fpp-Server ~]$ rhpctl query image -image db_19300 Picked up _JAVA_OPTIONS: -XX:ParallelGCThreads=2 fpp-Server.evilcorp.com: Audit ID: 3 Image name: db_19300 Owner: grid@london-fleet-c Site: london-fleet-c Access control: USER:grid@london-fleet-c Access control: ROLE:OTHER Access control: ROLE:GH_IMG_PUBLISH Access control: ROLE:GH_IMG_ADMIN Access control: ROLE:GH_IMG_VISIBILITY Parent Image: Software home path: /rhp_storage/images/idb_19300208165/.ACFS/snaps/idb_19300/swhome Image state: PUBLISHED Image size: 6536 Megabytes Image Type: ORACLEDBSOFTWARE <<---- Image Version: 188.8.131.52.0:184.108.40.206.0 <<---- Groups configured in the image: OSDBA=dba,OSOPER=oper,OSBACKUP=backupdba,OSDG=dgdba,OSKM=kmdba,OSRAC=racdba Image platform: Linux_AMD64 Interim patches installed: 29585399,29517242 Contains a non-rolling patch: FALSE Complete: TRUE
2. Import GRID Image
[grid@fpp-S]$ rhpctl import image -image gi_19300 -imagetype ORACLEGISOFTWARE -zip /vagrant/ORCL_software/LINUX.X64_193000_grid_home.zip QUERY IMAGE ============ [grid@fpp-Server ~]$ rhpctl query image -image gi_19300 Picked up _JAVA_OPTIONS: -XX:ParallelGCThreads=2 fpp-Server.evilcorp.com: Audit ID: 5 Image name: gi_19300 Owner: grid@london-fleet-c Site: london-fleet-c Access control: USER:grid@london-fleet-c Access control: ROLE:OTHER Access control: ROLE:GH_IMG_PUBLISH Access control: ROLE:GH_IMG_ADMIN Access control: ROLE:GH_IMG_VISIBILITY Parent Image: Software home path: /rhp_storage/images/igi_19300182669/.ACFS/snaps/igi_19300/swhome Image state: PUBLISHED Image size: 6032 Megabytes Image Type: ORACLEGISOFTWARE <<---- Image Version: 220.127.116.11.0:18.104.22.168.0 <<----- Groups configured in the image: OSDBA=dba,OSASM=dba,OSBACKUP=dba,OSDG=dba,OSKM=dba,OSRAC=dba Image platform: Linux_AMD64 Interim patches installed: 29585399,29517247,29517242,29401763 Contains a non-rolling patch: FALSE Complete: TRUE
3. Import existing 12c DB_HOME:
This one is a bit tricky as rhpctl relies on nfs to do the job and it wasn’t enabled by default in the original build.
I’ll update the setup script so you won’t have to start the nfs service manually.
# Setup update # systemctl enable/start nfs-server [grid@fpp-S]$ rhpctl import image -image db_12102 -imagetype ORACLEDBSOFTWARE -path /u01/app/oracle/product/22.214.171.124/dbhome_1 -targetnode fpp-Client -root Enter user "root" password:xxxx QUERY IMAGE ============ [grid@fpp-Server ~]$ rhpctl query image -image db_12102 fpp-Server.evilcorp.com: Audit ID: 17 Image name: db_12102 Owner: grid@london-fleet-c Site: london-fleet-c Access control: USER:grid@london-fleet-c Access control: ROLE:OTHER Access control: ROLE:GH_IMG_PUBLISH Access control: ROLE:GH_IMG_ADMIN Access control: ROLE:GH_IMG_VISIBILITY Parent Image: Software home path: /rhp_storage/images/idb_12102399207/swhome Image state: PUBLISHED Image size: 5320 Megabytes Image Type: ORACLEDBSOFTWARE Image Version: 126.96.36.199.0 Groups configured in the image: OSDBA=dba,OSBACKUP=dba,OSDG=dba,OSKM=dba Image platform: Linux_AMD64 Interim patches installed: Contains a non-rolling patch: FALSE Complete: TRUE
4. UPGRADE a 12c DB to 19c in one command
FPP can’t upgrade a non-CDB to PDB (uses DBUA). That being said, I had a successful CDB upgrade with 100% completion but a warning that wasn’t impactful.
Provision the 19c working copy
[grid]$ rhpctl add workingcopy -workingcopy wc_db_19300 -image db_19300 -user oracle -groups OSBACKUP=dba,OSDG=dba,OSKM=dba,OSRAC=dba -oraclebase /u01/app/oracle -path /u01/app/oracle/product/19.0.0/dbhome_1 -targetnode fpp-Client -root Enter user "root" password:xxxx
Upgrade 12c cdb1 to 19c
[grid]$ rhpctl upgrade database -dbname cdb1 -sourcehome /u01/app/oracle/product/188.8.131.52/dbhome_1 -destwc wc_db_19300 -targetnode fpp-Client -root Enter user "root" password:xxxx ... 100% complete fpp-Server.evilcorp.com: Completed the upgrade database operation SQL> @check_pdb PDB_ID PDB_NAME STATUS ------- --------- -------- 2 PDB$SEED NORMAL 3 PDB1 NORMAL NAME OPEN_MODE RES PDB_COUNT LOCAL_UNDO TOTAL_MB BLOCK_SIZE --------- ---------- --- ---------- ---------- ---------- ---------- PDB$SEED READ ONLY NO 0 0 1160 8192 PDB1 READ WRITE NO 0 0 1122 8192 $ Lsnrctl status LSNRCTL for Linux: Version 184.108.40.206.0 - Production on 09-NOV-2020 15:58:15 Service "pdb1" has 1 instance(s). Instance "cdb1", status READY, has 1 handler(s) for this service...
There is only so much we can talk about in a blog post but I hope this will encourage you to try it yourself. In case you want to know more about the available use cases for FPP please have a look at the below links :
Documentation can sometimes be unclear which led me to reach out to the Oracle MAA team about this. The good thing is that it’ll help me build a little FAQ based on their output around FFP concepts… but that’ll be a topic for my next article;), Stay tuned!