Category Archives: Daily Blog

Generally a bunch of various small items that come up on a given day. Less focused than other topics, a catch-all…

Playing with Python

I was playing with Python a bit more over the weekend. It is a serviceable language but I am persistently amused/irritated by a few things.

The python 2/3 breaking incompatibility split seems to be persistent, entrenched and troubling. It appears that the .NET and java ports (jython and iron python) have still not made the transition to python 3. The cython baseline and web site are now confidently stating that python 3 is the present and python 2 is the past, yet I’d expect that if that were really true, the other python implementations would at least support python 3 and ideally would have the same position with regards to python 2.

I was watching a video discussing some python features and they mocked the curly brace languages for having religious wars about where to put the braces. I have a general aversion to using white space (a very poorly conserved type of text) for block scoping as far too many tools consider spaces and tabs to be adjustable and interchangeable. The thing I find amusing here is that I’ve seen far more friction in the python community between use of spaces or tabs and how many spaces per indent level than I’ve ever seen around the placement of curly braces.

I do expect to replace perl with python for various places and the OpenCV support looks quite interesting. I think that in time the style issues will feel less foreign and I very much hope that the 2/3 split will be dealt with in the overall community as JVM and CLR versions of the engine that implement a non-obsolete version of the language would be very nice to have.

More adventures with C++/CLI

I’ve been working with C++/CLI to get access to native API functionality from C# some more lately. I’ve been running into cases where something compiles flawlessly when I create the project but then fails miserably when pulled from GIT clean and rebuilt. I’m looking at various build issues that might be contributing to this and will hopefully find the right recipe soon.

Some notes here related to parts that matter and APIs that I’m looking to use…half of this for my own reference as I mess with solutions to see what works:

Marshaling strings the (relatively) easy way:

 #include <msclr/marshal.h>

System::String^ myPath = "ABC";
std::wstring path = msclr::interop::marshal_as(myPath);

File information:

typedef struct _FILE_ID_INFO {
ULONGLONG VolumeSerialNumber;
FILE_ID_128 FileId;
} FILE_ID_INFO, *PFILE_ID_INFO;

FILE_ID_INFO info;

BOOL ok = GetFileInformationByHandleEx(myHandle, FileIdInfo, &info, sizeof(info));

Alternate string marshaling:

inline void MarshalString(String ^ s, std::wstring& os) {
using namespace Runtime::InteropServices;
const wchar_t* chars =
(const wchar_t)Marshal::StringToHGlobalUni(s)).ToPointer();
os = chars;
Marshal::FreeHGlobal(IntPtr((void)chars));
}

Volume information:

BOOL ok = GetVolumeInformationW(path.c_str(),
volumeNameBuffer, MAX_PATH + 1,
&serial,
&pathLength,
&flags,
filesSystemName, MAX_PATH + 1);

File attributes (can be used on c:\ to find things like volume creation time stamp)

WIN32_FILE_ATTRIBUTE_DATA info;     
BOOL ok(GetFileAttributesExW(path.c_str(),
  GetFileExInfoStandard,
static_cast<void *>(&info)));

creationDate = gcnew System::DateTime((long long)(info.ftCreationTime.dwLowDateTime) | ((long long)(info.ftCreationTime.dwHighDateTime) << 32));

Additional volume information:

    wchar_t volumeName[1024];     wchar_t fsName[1024];     DWORD vsn;     DWORD fsflags;     BOOL ok(GetVolumeInformationW(path.c_str(),         volumeName, 1024,         &vsn,         nullptr,         &fsflags,         fsName, 1024));

and

    ULARGE_INTEGER free;     ULARGE_INTEGER total;     ULARGE_INTEGER totalfree;     BOOL ok(GetDiskFreeSpaceExW(path.c_str(), &free, &total, &totalfree));

and basic info

FILE_BASIC_INFO info;
BOOL ok(GetFileInformationByHandleEx(handle, FileBasicInfo, static_cast(&info), sizeof(info)));

Busy week and weekend

…of work related C# and java code. Things stay busy and old projects need additional work as changes happen.

Spent a good chunk of the weekend and several nights last week making sure that work priorities were attended to.

Less fun than messing with sandbox projects, but work does generally come first at the end of the day. Toy projects can slip schedules almost indefinitely…

Looking forward to 2019

Well, 2018 was a bit tumultuous. Lots of high points and a similar number of disappointments. I feel as if I’m ending this year about even with where I began it. Some wins, some losses, mostly evening out overall.

Hoping for more from the year coming up. The gyrations of the previous year have helped to shake out some things that needed shaking out. Expectations are set more reasonably and I think the coming year will move more steadily forward along a less erratic course.

I’m expecting a productive year with things better squared away and the path forward clearer that it has been for some time. Lots to get to…much of it potentially exciting.

This last year I wrapped up the program I had been running as software lead. Lots of C#, WPF and Angular running medical robotics with a team of three software engineers working for me. Since that rolled to a successful close I’ve been filling as as an individual contributor on a Java based instrumentation program. Hoping that the new year will bring in a new challenge as this program is wrapped up and handed off. Plenty of challenges to tackle and lots of diversity in the work ahead.

I’m looking to get my RapRap build rolling on the home front. I’ve had most of the relevant electronics around for some time but have always had other priorities bumping work on the 3D printer aside. This year I have friends who are willing to help out with the build and my basement work-bench cleared and ready for action. I’ll need to order parts and run through the build process, but I expect that things will go more smoothly at this point than they have in some time.

I’ve spent a chunk of time over the KMC holiday break (KMC usually keeps enough scheduled holidays in reserve to shut down for the week between Christmas and New Years) getting some progress on file management tools I’ve been playing with for some time. Hoping this time that I’ll get some completed tools running to assist in managing the current sprawl of files on my machines here.

I’m also hoping to get around to some real VR coding this year. I’ve had an HTC Vive here for some time. This year its time to lay down some code and play with this thing’s capabilities in a real way. I expect Unity will likely be a reasonable platform to build things on. I’m also expecting to put more time into learning blender and improving my drawing skills to support the effort. Time will tell where this might go, but there’s plenty to play with.

I’ve poked at VHDL a bit over the last year. I have a break-out board with a Xilinx FPGA on it in my drawer here. I’m not sure whether any more work on this front will happen this year as I expect other priorities to dominate…but again, time will tell.

I also expect to get back to doing more photography. I’ve fallen out of the habit of taking pictures just for the sake of making pretty shots. I need to spend a bit more time in the coming year making art in addition to building code and learning tools…need to find a balance here as with all things.

Monday, Dec 10, 2018

Trying to get back on track with sandbox work at home.

I’m taking another run at the tool for archive management and de-duplication processing that has been on the plate for some time. This tool wants to read files, determine uniqueness of files (based on content) and maintain an index (likely in MongoDB) of files that have been scanned and are expected to exist. I’m writing things in C# mostly. The current user interface approach involves WPF but may also make use of ASP.NET (probably core) at some point. Looking to solve a problem and play with some coding tools on this front.

I’ve got better versions of my interop C++/CLI code to provide access to Win32 volume and file information functions in place and tested. I have not yet pushed these up to github as they’re still just free-standing code without anything to actively run them.

I’m expecting to put in place some more helper code shortly and then build out a simple WPF interface to run things. I also want/need to build a more capable MongoDB back end to hold file scan results as part of the process,

Holidays are a busy time…

Haven’t gotten much done on a technical front (aside from work items) in a while as other things have been dominating my time (partly work there as well).

Really going to have to get the RepRap work going once the workbench in the basement is cleared for real work (one of the areas that is taking time…cleaning the basement). Also been doing a quick emacs-lisp refresher as I’d like to get some things done on that front.

I did drag the intuos tablet down to the living room. I hope to find time to do some drawing and blender work here and there soon as that is less time consuming and can be done in small bits. I need to locate my corel painter install files and get that package on the living-room NUC. I suspect that responsiveness may be better there than on the big machine in my office too.

VirtualBox supports multiple monitors…

I’ve been using VirtualBox pretty heavily to partition things out on my systems where some tasks require setups that clash at the OS level.

I generally find multiple monitors to be exceptionally helpful in software development settings. I’ve been running with my Virtual Box VMs on one monitor and using the other monitors for host OS based windows…and this has worked pretty well.

This morning I decided to take a look at the configuration settings for my main VM and to my delight I found that it is possible to configure additional monitors and place them on the desktop. This should streamline things when developing on a VM as it allows me to keep my IDE full screen on one screen while using a second for other activities.

Now if I can only figure out how to make Docker and Virtual Box live together in harmony at home (Docker wants Hyper-V while Virtual Box can’t run under that hypervisor) I’ll be feeling pretty happy.

Native extensions to Python

I spent a little time last night looking at the coding requirements for creating native (C essentially) extensions to Python. This has come up previously in conversations as another way to make native code accessible functions available for scripting by folks who aren’t development engineers.

The facility appears similar in style to that provided for writing perl extensions or JNI. No surprise here. I’ll probably try playing with this a little bit sometime soon just to get a feel for the full series of steps. The process involved in getting the *.dll or *.so file into the right spot to be usable seems a little bit opaque, but perhaps it is just so automated that it isn’t much of an issue.

I’m not a huge fan of Python but it has a huge following and seems to be a useful intermediate step between shell scripting sorts of activity and full powered implementation languages (C++/C#/Java).

I wish python had not chosen such a poorly conserved item as white-space to represent block scoping (the tabs/spaces issues are not generally fixable without making the representation issues worse). They also seem to have created a permanent 2.x/3.x schism where quite a few years after the major version upgrade there is still a substantial amount of code on either side of the divide. Perl 5/6 had a similar issue, but perl 6 never seems to have taken off so the impact is much smaller.

Some links that seemed useful:

JavaFX Event Handling

I’m finding myself needing a better understanding of JavaFX UI event handling and my basic JavaFX books seem to ignore most of that aspect of the system. It looks as if the wiring of UI events is buried deep enough and the handling is automated enough that most of the time there’s no need to directly interact with events.

I need to perform an action when a given UI panel is exposed after being hidden…a simple enough activity in most cases. I expect I’ll find the right controls soon enough, just a bit surprised that they’re not talked about as directly as I’m used to.

Looking as if the easy route to this may be to name the top level pane in a given area and then attach a ‘show’ handler to that pane. Hoping this works as this would make it pretty easy to do what I need to get done.

Some links that I’m recording for later convenience (some just interesting here not directly relevant):

The charting and 3D API items are of interest, but not part of this, but I’m trying to keep notes on where things were found so that I can go back and dig deeper later…a small amount of clutter for convenience…