We’ve all been there… You head over to the Session Catalog for CloudWorld and you want to download the files for all of the sessions you have been to, and all of the sessions you have missed.

Then you discover… you need to click on each session to see the file name to download…. Ugh!

So you’ll be pleased to know someone has done the hard yards for you and trawled the catalog to get all the file names, session codes and titles to build the annual OCW mega-download shell script!

(“Thank you”s in terms of bottles of gin can be sent to Connor McDonald, care of, Oracle Perth 🙂 )

I can’t make any guarantees of correctness etc, because I did this by getting down into the JSON weeds, parsing out the web request responses to dig out the files and sessions, but hopefully it’s going to be mostly correct.

Currently, the downloads are available only to session attendees, so this mean you have SSO in with your attendee credentials. Thus the challenge here is then how to fold this into a script.

Here is how to proceed.

1) Go to the session catalog and click on any session. I’ve picked one of my mine as an example

image

2) If you do not see a presentation download link, you need to SSO in with your CloudWorld attendee credentials.

 

image

Now we need to grab the cookie information for your browser session so that we can use it to download all of the sessions. Fire up Developer Tools, head over to the Network tab and refresh your page.

You’ll see lots of sources get populated. Head down to the find the one marked “session” with a POST method. Right click and choose “Copy as CURL (bash)”

cloudworld_curl

Open up your favourite text editor and paste the clipboard. It will look something like the command below.

 

image

The key line we need here is the “Cookie” line, which is my case is on line 7. Copy-paste that to your clipboard.

Now grab two files from my github repo

1) List of all the presentations https://raw.githubusercontent.com/connormcd/misc-scripts/refs/heads/master/ocw_file_list

2) Shell script to download the presentations https://raw.githubusercontent.com/connormcd/misc-scripts/refs/heads/master/ocw_get_files.sh

Replace the cookie line in the script with the true cookie details from the ‘curl’ script your previously copied.


cat ocw_file_list | while read f1 f2
do
  echo $f1 $f2
  curl -o $f1 "$f2" \
    -H $'Cookie: ....' 
done

Now you’re ready to run your script and grab all the great CloudWorld content! Each file will be named the session code (eg LRN1234) followed by the session title.

Enjoy!

5 responses to “The CloudWorld 2024 mega download!”

  1. Hello Connor :-),

    I’m wondering how to acquire the OCW file list – https://raw.githubusercontent.com/connormcd/misc-scripts/refs/heads/master/ocw_file_list

    I intend to explore https://raw.githubusercontent.com/connormcd/misc-scripts/refs/heads/master/ocw_get_files.sh for CMD windows code.

    Another good idea is whether you are able to add the button “All Download Sessions” in https://apex.oracle.com/pls/apex/r/connor/ocw/home.

    Best Regards

    Quanwen Zhao

  2. Hello Connor :-),

    Based on your note I’ve gone to download OCW24 sessions you offered but seems to miss out some when performing them. Here is my latest note https://quanwenzhao.wordpress.com/2024/09/22/the-step-by-step-downloading-ocw24-sessions/ to record the entire process, but you probably prefer to read https://quanwenzhao.wordpress.com/wp-content/uploads/2024/09/download-ocw24-sessions.pdf.

    By the way I am wondering that how to acquire https://raw.githubusercontent.com/connormcd/misc-scripts/refs/heads/master/ocw_file_list.

    Best Regards
    Quanwen Zhao

    1. Looks to me like you tried to bypass the cookie option….which means you’d miss lots of them.

      I will blog separately on the file list

      1. When adding my cookie I’ve just only downloaded 405 sessions (but 579 sessions if no cookie), still no full sessions either cookie or not …

        I’ll try again it according to Clayton Royal’s method as below!

        Best Regards

        Quanwen Zhao

  3. YOU ARE AWESOME CONNOR MCDONALD!!!!!!

    I was able to use the Firefox extension DownThemAll! https://www.downthemall.org/ on your List of all the presentations https://raw.githubusercontent.com/connormcd/misc-scripts/refs/heads/master/ocw_file_list for full download.

Got some thoughts? Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Trending