vanderwal.net

A Blog Move and Thin Catch-up

Yah, I know. It has been a while. Some things have changed, as I’m searching for what is next on the work front. Where I was it was a bit restrictive on sharing outward, so things got a little quiet. I’m still working on the Social Lenses / Complexity Lenses and have 80 to 90 stubs of ideas in my backlog of blogfodder, for here or the Personal InfoCloud.

A Move of Personal InfoCloud

I hadn’t posted to my blog, Personal InfoCloud in a long while. I was in the midst of a 16 part “Shift Happened” series, which was hitting embracing complexity as the next part of the series. I’m not sure if or when I will return to that. But, my work agreement frowned on sharing things out and I had a long negotiation about my prior work and corpus of IP around the Complexity Lenses. But, now that I’m back and able to freely write and share again I realized my blog where that happened much of the time needed to move off SquareSpace. Why? Poor customer support and small things breaking and them blaming me, when I hadn’t touched it in years.

The last two plus months I focussed on the move out and into another platform. I had looked at a few options for a month or so prior, but SquareSpace had one easy export path out, which is to WordPress, which I could self host (I have a few small blogs and sites that I have on self-hosted WP and they are fine). While there is a lot of turmoil in the WordPress sphere, going with the self-hosted option seems viable as a transition, if not longer option. I did an export of my SquareSpace site and in 20 minutes of export I had all my posts in WP and all comments, tags / categories, most media in blog posts, and the structure was there.

While the first step was 20 minutes to get to about 80 percent of a move done, the next portion took about two months between many meetings around advisory to start-ups, discussions about next steps (everybody was holding out until after the election, then to sort out what level of chaos may ensue, now…, and finding a lot of interest it is just getting things to a reality), mentoring professionally to director and up leadership in product management and cross-functional design and development engineering (with a lot of data focus and AI), data analytics and analysis of my own 20+ years of what I know so it can be better organized for others to pick-up. But, I had a deadline of the first week of February for the move out of SquareSpace to take place, as it was the next billing cycle.

The last two months of the move of the blog focussed on getting the design transitioned over or finding a viable design theme to use and bend to something I could work with. I found something, but it came with a lot of options and capabilities, which I initially embraced, then started printing out screens to single screen PDFs and taking the red pen to them (even after the move I think there are some things that may go, but also things that need work to come back). The next big haul was touching every post fixing some media links broken and fixing the URLs, which included the pre-post name date slug as part of the post name. I got those finally sorted out at the end of last week and Thursday I started moving the domains (from where I was developing it in a sandbox), shift to the production site, adding certificates, fixing odd typography issues, fixing routing issues, and other oddities. I hit the deadline.

Move Done and Next Steps for PIC

With the move done, I didn’t realize how much stress and mental clutter I had tied up in that move. I was managing todo lists in Obsidian, GitHub, and some quick reminders with times and dates on them. I felt free to start thinking about what I was focussing on two months prior and a ton of pressure released.

With the Personal InfoCloud blog I still need to fix links that go to Slideshare as most are broken, but I need to sort out what I want to do with those presentations. Jon and Rashmi have started a new replacement for Slideshare as a modern attempt, which I need to try a bit more and assess the fit for needs.

I also need to sort out the homepage of the site, as I’ve long wanted to have a homepage that sits in front of the blogs. I have that now, but I’m not happy with it. With the deadline out of the way I can have it as one of my projects I’m working through.

The categories, post listing, and search is also something I need to re-think and get into a better state. When I moved from TypePad to SquareSpace in 2011 to 2012 there wasn’t a good way to manage this, and what I cobbled together I hated. But, for PIC the platform is something I don’t want to think about I just want to use to post things I write. WordPress has a lot more options and I played with a couple before I put a hard focus on making the deadline about 5 to 6 weeks ago.

I have quite a few blog posts ready to be written. An introduction to the Complexity Lenses (there are over 90 of them now and in my master outline of them with sub-nodes there are over 1,500 nodes all together, which each node capable of being a page to at least 5 pages of explanation). This introduction post may iterate over time, which I’m fine with and not true blog with a line in time tied to it that other posts have. I also need to write up my “20 Social Roles”, which I do a lot of work around helping organizations sort through the roles and dynamics of their work, collaborating, cooperative, and collective environments, but also tool and platform builders creating tools that close the gaps of missing support for any and all of these Social Roles.

What Happens Here?

Here at vanderwal.net I need to get back to building a habit of blogging again. The weeknote is something I may do to help my rhythm. I still write a ton, but it is all in my notes. My daily notes, or “Daily Dump”, looks an awful lot like my first 4 to 7 years of blogging here (so 2000 to 2007 / 2008), before short snippets and observations started ending up in Twitter.

I still need to spend a week of heads down work to update the underlying code that the site runs on. I started that about 2 years back, but a day or two here and there weren’t cutting it and not a good way to make progress, particularly since it requires rewriting the code on my many templates to get data out and filling the pages in. Once that is done I have a few things I really want to address, like pagination on tag pages, and fixing the flow of the blog across time.

Whew!

If you have interest in chatting and catching up, or if you have a project, product, or work you would like help with please reach out.

Take care.

Non-UNIX Timestamping has Me Stamping in Frustration

In the slow process of updating things here on this site I have nearly finished with the restructuring the HTML (exception is the about page, which everytime I start on it the changes I start to make lead quickly to a bigger redesign).

Taking a break from the last HTML page restructuring I was looking at finally getting to correctly timestamping and listing the post times based on blog posting location. Everything after the 1783rd blog post currently picks up the server time stamp and that server is sitting in Eastern Australia, so everything (other than blog posts from Sydney) are not correctly timestamped. Most things are 14 to 15 hours ahead of when they were posted - yes, posted from the future.

Looking at my MySQL tables I didn’t use a Unix timestamp, but a SQL datetime as the core date stored and then split the date and time into separate varables created with parsing timestamp in PHP. This leaves 3 columns to convert. It is a few scripts to write, but not bad, but just a bit of a pain. Also in this change is setting up time conversions that are built into the post location, but shifts in time for day light savings starts adding pain that I don’t want to introduce. I’ve been considering posting in GMT / UTC and on client side showing the posting time with relative user local time with a little JavaScript.

I would like to do this before a server / host move I’ve been considering. At this point I may set up a move and just keep track of the first post on the new server, then at some point correct the time for the roughly 500 posts while the server was in Eastern Australia.

The Data Journalism Handbook is Available

The Data Journalism Handbook is finally available online and soon as the book Data Journalism Handbook - from Amazon or The Data Journalism Handbook - from O’Reilly, which is quite exciting. Why you ask?

In the October of 2010 the Guardian in the UK posted a Data Journalism How To Guide that was fantastic. This was a great resource not only for data journalists, but for anybody who has interest in finding, gathering, assessing, and doing something with the data that is shared found in the world around us. These skill are not the sort of thing that many of us grew up with nor learned in school, nor are taught in most schools today (that is another giant problem). This tutorial taught me a few things that have been of great benefit and filled in gaps I had in my tool bag that was still mostly rusty and built using the tool set I picked up in the mid-90s in grad school in public policy analysis.

In the Fall of 2011 at MozFest in London many data journalist and others of like mind got together to share their knowledge. Out of this gathering was the realization and starting point for the handbook. Journalists are not typically those who have the deep data skills, but if they can learn (not a huge mound to climb) and have it made sensible and relatively easy in bite sized chunk the journalists will be better off.

All of us can benefit from this book in our own hands. Getting to the basics of how gather and think through data and the questions around it, all the way through how to graphically display that data is incredibly beneficial. I know many people who have contributed to this Handbook and think the world of their contributions. Skimming through the version that is one the web I can quickly see this is going to be an essential reference for all, not just journalists, nor bloggers, but for everybody. This could and likely should be the book used in classes in high schools and university information essentials taught first semester first year.

Mac Cocoa interface for MySQL

A Mac Cocoa interface for MySQL looks promising.

ODBC on Apple Jaguar

ODBC in Apple Jaguar to help share data between applications.

MySQL becoming a viable choice for corporations

Fortune's David Kirkpatrick discusses MySQL Database being very popular on the Web and it is free. This is not a suprise to many of us as I thought I was the last to use MySQL in 2000 for a professional project. I quickly found that the combination of MySQL with PHP on a Sun Solaris U10 could provide 70k to 90k page builds per hour. That was nearly static rates when compared to a Windows box. One of the nice things we found was MySQL was not only lightening fast, but very well suited for Web development and driving content dynamically. MySQL is the type of database the MS Access could have been. MySQL is what is behind this site and works wonderfully. The database does not currently have transactions, which is not needed for most of the work where it is used.

I was very happy to learn MySQL is profitable. It was very odd that somebody in the article brought up all the money that is being left on the table for MySQL. The CEO of MySQL gave a fitting responce in asking what the other companies were doing with the money they charged. I was pleased as punch that MySQL is at home on every Mac running OS X.

MySQL for Jaguar

MySQL for Jaguar loaded wonderfully and easily.

Metadata article store

Metadata articles collected by the Database Knowledge Base over at IT Toolbox. [hat tip Victor]

PHP and MySQL for managing images on the Web

Managing Images With a Web Database Application with PHP and MySQL and nothing up the sleeves. The folks from O'Reilly Net offer this one, which is not in the Web Database Applications with PHP and MySQL. The book is one of my favorite information application development books at the moment for a variety of reasons: ease of coding principles, explaining application development, explaination, then using what is learned and implementing it.

WYSIWYG in browser part two

The second part to theWYSIWYG editor in a Web browser is available. This section gets into implementing the HTML portion from the first section into the storage components of this article.

So you want to build your own weblog tool like the one here? Start with PHP and MySQL with a little Apache and a sprinkling of arrays and script code. Yes, this is basically what is under this puppy.

O'Reilly Net continues its Apache on OS X series with integration of MySQL. This is one element I have not set-up as of yet and one that will make development of this site much easier and also make the development portable.

Web Reference guides us through efficient SQL calls to the database. Effiecient calls help speed the application's presentation and puts less of a demand on the server's resources.

Ah, an even newer update to MySQL on Mac OS X. My last build was a little buggy, which was to versions back. It is seeming that it is contiually a good thing to follow the setup info on Marc Liyanage site.

Okay, O'Reilly Net has been offering a lot of good resources of late and I am a little behind in catching up.

Those of us that need a light weight database for a small project and are using Microsoft Windows often turn to Access to perform the task. Steven Roman offers his tips in how to set up an Access database. The best tip is right up front:

Don't touch your PC until you have taken the time to rough out a design of your database.

The tips keep coming and many of them apply to any other database development. Once I learned to think of information and metadata in a relational database format (which also helps with setting up XML documents) application development became easier. Understanding a little database design will also help ask the right questions when setting up an application, database, and/or project.

This article also helps define the limitations of Access databases. Each database will have its own limitations or peculiarities. Knowing these differences will help think about the application, information, and how they can and will be used is helpful.