Roger Cigol

I am using C++ Builder (RAD Studio 12.0) compiling to a Win64 VCL project working with PostgreSQL 13 database. RAD Studio 12.0 includes the bug fix of RSP-28292 - use of SQLTimeStampOffset fields in FireDAC. I have fields in my postgreSQL tables that are type TimeStampWithTimeZone. When viewed using PgAdmin4 they display values such as 2024-01-15 15:05:12+00 (for winter in the UK = UTC) or 2016-06-09 15:13:03+01 (for summer in the UK = BTS - one hour ahead of UTC). I use fireDAC TFDQuery and obtain datasets with these fields in. If I use // ToBeRead is the TField pointer within the dataset (typically obtained using FieldByName()) TSQLTimeStampOffset UTC_O = ToBeRead->AsSQLTimeStampOffset; Then I get a value in UTC_0 which has a time offset figure of zero and the hours compensated for. Using the above two examples this would mean UTC_0 would be equal to {2024, 01, 15, 15, 05, 12, 0, 0, 0} or {2016, 06, 09, 14, 13, 03, 0, 0, 0} // note: time offset is returned as zero and the hours value has been decremented by 1 This is not the behaviour I expected. I thought I would get the value as local time and with the time offset value set to the same value as displayed by pgAdmin4, ie for the summer case, I would expect {2016, 06, 09, 15, 13, 03, 0, 1, 0} // result in BST and time offset = 1 hour Users of my software want to see the time values displayed in local time (of course) so I have to convert this UTC value to BST for date/time values in the summer. RAD Studio 12.0 doesn't seem to implement functions UTCToLoca() or LocalToUTC() for arguments of type TSQLTimeStampOffset. It DOES implement these functions for type TSQLTimeStamp. So I am forced to first convert my TSQLTimeStampOffset to a TSQLTimeStamp value and then convert it to local time. I use this code.... TDateTime GetPgSQLDataSetFieldAsLocalTime(TField *ToBeRead) { TDateTime LocalDateTime; if (ToBeRead) { // Reading AsSQLTimeStampOffset seems to return UTC value // (ie TimeZone is Zero and hours (+days etc) have been compensated correctly) // This is not ideal ! TSQLTimeStampOffset UTC_O = ToBeRead->AsSQLTimeStampOffset; TSQLTimeStamp UTC; UTC.Year = UTC_O.Year; UTC.Month = UTC_O.Month; UTC.Day = UTC_O.Day; UTC.Hour = UTC_O.Hour; UTC.Minute = UTC_O.Minute; UTC.Second = UTC_O.Second; UTC.Fractions = UTC_O.Fractions; TSQLTimeStamp Local = UTCToLocal(UTC); LocalDateTime = SQLTimeStampToDateTime(Local); } return LocalDateTime; } This all works but it all has the feel of being a "work around". To update the field from a local time I am now using this code. void UpdatePgSQLDataSetFieldFromLocalTime(TField *ToBeUpdated, TDateTime LocalDateTime) { if (ToBeUpdated) { TSQLTimeStamp Local = DateTimeToSQLTimeStamp(LocalDateTime); TSQLTimeStamp UTC = LocalToUTC(Local); TSQLTimeStampOffset UTC_O; UTC_O.Year = UTC.Year; UTC_O.Month = UTC.Month; UTC_O.Day = UTC.Day; UTC_O.Hour = UTC.Hour; UTC_O.Minute = UTC.Minute; UTC_O.Second = UTC.Second; UTC_O.Fractions = UTC.Fractions; UTC_O.TimeZoneHour = 0; UTC_O.TimeZoneMinute = 0; ToBeUpdated->AsSQLTimeStampOffset = UTC_O; } } Again, this all works. But it all seems fairly "hard work" to code. I post the code here in case it helps anyone out. I am interested to know if anyone has a better way of working with TimeStampWithTimeZone field types and local time values.

Just realised I missed out the (trivial) definitions of AllOkA and AllOkB at the top of the code: For completeness I add: bool AllOkA = false; bool AllOkB = false;

I thought I would add some code with "what doesn't work" and how to use the above two functions to make it work. Assume you have a postgreSQL database connected and that you have a query that returns a record that contains a date/time value and that the database stores this value as a "time stamp with time zone" format (PostgreSQL users can call this timestamptz). I would expect the following code to work - but after you run it AllOkA is true (showing it works for UTC local time) but AllOkB is false (showing it falls over for BST (British Summer Time)). TFDQuery *FDQuery = SampleFDQuery; // a query which returns a record with a timestampwithoffset field FDQuery->Close(); // work with the oldest record (any one would do) FDQuery->ParamByName(SSQP_PrimaryKey)->AsLargeInt = 1; FDQuery->OpenOrExecute(); FDQuery->First(); // should only be one entry TField *Field = FDQuery->FieldByName(PG_Sensors_TimeDate); // try a winter time (January) (this is UTC - works without special function calls TDateTime WinterLocalDateTime{2020, 1, 17, 9, 8, 7, 0}; FDQuery->Edit(); Field->AsDateTime = WinterLocalDateTime; //=== FDQuery->Post(); FDQuery->Close(); FDQuery->OpenOrExecute(); Field = FDQuery->FieldByName(PG_Sensors_TimeDate); TDateTime Check = Field->AsDateTime; //=== FDQuery->Close(); AllOkA = (WinterLocalDateTime == Check); if (AllOkA) { FDQuery->OpenOrExecute(); Field = FDQuery->FieldByName(PG_Sensors_TimeDate); // try a summer time (June) (BST - one hour ahead of UTC) TDateTime SummerLocalDateTime{2020, 6, 17, 9, 8, 7, 0}; FDQuery->Edit(); Field->AsDateTime = SummerLocalDateTime; //=== FDQuery->Post(); FDQuery->Close(); FDQuery->OpenOrExecute(); Field = FDQuery->FieldByName(PG_Sensors_TimeDate); Check = Field->AsDateTime; //=== FDQuery->Close(); AllOkB = (SummerLocalDateTime == Check); } If I replace the lines with comments //=== with calls to the functions given in my previous posting I get code that works for both winter and BST summer times (ie both AllOkA and AllOkB are true at the end of the code). TFDQuery *FDQuery = SampleFDQuery; // a query which returns a record with a timestampwithoffset field FDQuery->Close(); // work with the oldest record (any one would do) FDQuery->ParamByName(SSQP_PrimaryKey)->AsLargeInt = 1; FDQuery->OpenOrExecute(); FDQuery->First(); // should only be one entry TField *Field = FDQuery->FieldByName(PG_Sensors_TimeDate); // try a winter time (January) (this is UTC - works without special function calls TDateTime WinterLocalDateTime{2020, 1, 17, 9, 8, 7, 0}; FDQuery->Edit(); UpdatePgSQLDataSetFieldIfNotDefaultDate(Field, WinterLocalDateTime); //=== FDQuery->Post(); FDQuery->Close(); FDQuery->OpenOrExecute(); Field = FDQuery->FieldByName(PG_Sensors_TimeDate); TDateTime Check = GetPgSQLDataSetFieldAsLocalTime(Field); //=== FDQuery->Close(); AllOkA = (WinterLocalDateTime == Check); if (AllOkA) { FDQuery->OpenOrExecute(); Field = FDQuery->FieldByName(PG_Sensors_TimeDate); // try a summer time (June) (BST - one hour ahead of UTC) TDateTime SummerLocalDateTime{2020, 6, 17, 9, 8, 7, 0}; FDQuery->Edit(); UpdatePgSQLDataSetFieldIfNotDefaultDate(Field, SummerLocalDateTime);//=== FDQuery->Post(); FDQuery->Close(); FDQuery->OpenOrExecute(); Field = FDQuery->FieldByName(PG_Sensors_TimeDate); Check = GetPgSQLDataSetFieldAsLocalTime(Field); //=== FDQuery->Close(); AllOkB = (SummerLocalDateTime == Check); } I do not have a copy of Microsoft SQLServer but I would think it very likely that the same problem exists with this too. (but am wise enough to wait for someone else to verity this !).

It is very unusual to want to create an XML file and then at some later time set the values. What purpose does an XML file with no values in serve? How you create an XML file from data values that you have is (probably) your question. The answer to this may depend on where the values are coming from. The Embarcadero XML mapper tool (available on Getit - EXCEPT AT THIS MOMENT IN TIME (JAN 2024) GETIT IS BROKEN) allows you to take <at design time> an existing *.xsd schema and create a transofrmation that can then be used in your code so that <at run time> a TClientDataset can generate an XML file from the data it contains. I am aware that I am not helping with the "using OmniXml" part of your question but I mention the above in case it helps.

I am finding problems with RAD RAD Studio 12.0 - running C++ using Clang 64bit for a windows VCL project. If I insert a breakpoint it stops ok when the execution reaches the breakpoint. If I then try to single step sometimes it works. Most often I get a dialog appear (as per attached screen shot) but both "Wait" and "Terminate" buttons are frozen. Task manager shows RAD Studio is usage is "high" but everything is frozen. Only recovery is to shut down the entire RAD Studio using Task Manager. I get the same problems if I try to run it on a remote windows PC, deploying using PA Server. Anyone else seen this ?

I think I have found the area of my problem. If I put my breakpoint(s) in areas of code where "normal" code functions are happening then all is well. The opposite of "normal" is if I put a breakpoint in code that is interfacing with my postgreSQL (version 13 - 64 bit) database inside a database transaction then the debugger seems to hang / or do all sorts of bad things. I have my postgreSQL configured with various time outs. It makes debugging complicated database interaction (with several TFDQuery updates being used in one transaction) a bit tricky - but the IDE seems reliable if I avoid this - which is something that is workable.

Thank you Brian, I was not aware of this tool.

It also seems that the Getit package manager server is down - my "Getit" tool reports "No results found"

...and if you look in the sub directory __history you would find files *.pas.~1~ (and possibly *.pas.~2~ and *.pas.~3~ etc). These are the backup copy(s) you need. (The one with the highest number is the most recent).

Are you looking in the __history directory ?

Clipboard history was removed. The argument (probably valid) was that the Windows clipboard history does the job just as well (or better). Use left hand "Windows icon" key combined with "V" to bring up clipboard history.

It might be useful to edit the title of this post to "DUnitX passed in params are confusing" <ie add in the "X" on DUnitX> since this post refers to DUnitX (and not to DUnit). This may help people in the future who search on "DUnitX" for DunitX related postings.

You could tell us a bit about yourself too. Experience, interests, What version of RAD Studio you have etc etc. Do you have any C++ expertise ?

This looks like standard compiler memory alignment to me and is entirely expected. I am pretty sure that the compiler writers would take (gentle) issue with your "really no good reason" statement. I am not sure why it makes static analysis difficult - memory alignment is a common feature of many (most?) compilers. What static analysis tool are you using and where do you find the problem?

This is arguably one of the other significant benefits of designing code with Unit Testing in mind. It encourages you to write loosely coupled (or better entirely self standing) modules.... If you are dealing with legacy code this might be the case - but that doesn't mean that it is not worth effort. If you intend to keep the code live and supported for the future it almost certainly IS worth refactoring.

Most of the basic editing functions and keyboard short cuts of the text editor apply equally to Delphi or C++. But IDE menu Tools | Options and then scroll down to User Interface | Editor | Key mappings and the list of "out of the box" configurations does NOT include VIM.

I use it. Maybe I am a "nobody" ?

Actually, having said this before the webinar, I feel I should correct myself: the Visual Assist (including basic refactoring) looks like a HUGE step forward.

And if you ARE using C++ builder version 12.0 does not quite deliver as much as you'd think. The much anticipated new tool chain is only present if a very limited "preview" form.

Hi John, There's a webinar to tell you exactly this. Tomorrow (9th Nov) and also a blog summary: Marco's blog on Athens 12 If you scroll to the end of this blog there is a link to sign up for the webinar. I will be listening/watching in....

..... and I am still hoping that with the new C++ approach that will eventually come there will after that eventually be Android 64 bit C++ support.

I have an Alexandria 11.2 patch 1 VCL 64 bit windows application. I get the same problem running as an independant exe file or running under the RAD Studio IDE. I have a tick driven check function that has made the window invisible to the user by calling Hide(), on a previous tick. Then it checks for the state of a separate thread (via a lock to ensure concurrent access is ok). When the other thread indicates that it is ready to display the form it sets a flag and I then call Show() to display the form to the user. This works most of the time. But, rarely, I get to the checking state but the user can still see the form. I have added a check in the code to change the form colour if Visible == true (as a debug aid) and it DOES NOT change colour - so I know Visible is false. Here's my code where this occurs: case TSGS_WaitingForDisplayDecision: Status = "Waiting for display decision"; // elsewhere this is displayed on the form if (TestControl[TestControlID]) { TTestControlGUIInterface Info; TestControl[TestControlID]->TestControlGUIInterfaceData.Read_TS(Info); if (Info.GUIShouldBeVisible) { State = TSGS_DisplayMainTestForm; // this next state calls Show() to display the form } else if (Visible) { Color = clTeal; // when the fault occurs the form can be seen but it stays at the default colour } } break; a breakpoint at the line "Color = clTeal" is never hit - even though I can see the form on the screen <when the fault is present>. A breakpoint elsewhere in the code shown above is hit so I know I am passing through this state. Has anyone else ever seen anything similar?

I am interested in the library information passed to the linker. With my simple hide show project (source code zip already included above) if I compile for Win64 for debugging and have no entry in the Project | Options | C++ Shared Options | Library path for any of the available levels of the tree (ie nothing in All configuration all platforms, nothing in All configurations - Windows 64, nothing in Debug configuration, nothing Debug configuration - Windows 64 and nothing in Release configuration and nothing in release configuration Win 64) if I then look at the text in the Console Output tab following the TwineCompile full build I can see the paths passed to the ILinker as parameters of the -L switch. These are as follows: -L.\Win64\Debug; "d:\program files (x86)\embarcadero\studio\22.0\lib\win64\release"; "d:\program files (x86)\embarcadero\studio\22.0\lib\win64\release\psdk"; C:\Users\Public\Documents\Embarcadero\Studio\22.0\Dcp\Win64; C:\Users\Public\Documents\Embarcadero\Studio\22.0\DCP\Win64\Debug;C:\Users\Public\Documents\Embarcadero\Studio\22.0\Dcp\Win64 I don't think the second and third in this list should be "release" - I think they should be "debug". But how to fix this? where do these come from? If I open up the project file with a text editor and search for "release" there is no entry that is related to library file specification. so I don't think it is a problem with the project file.

Hi Harry, thanks for this: All help appreciated. In my case the form is NOT autocreated (I've removed it from the list in project | options). By displaying the value of "this" in my debug TEdit box and hitting a breakpoint I can confirm that I am on the correct instance of the form. Also the TEdit box clearly indicates that the form visible property is false - yet I am reading the TEdit box contents as it IS visible on the screen. This should never happen.

Hi Harry, thanks for this: All help appreciated. In my case the form is NOT autocreated (I've removed it from the list in project | options). By displaying the value of "this" in my debug TEdit box and hitting a breakpoint I can confirm that I am on the correct instance of the form. Also the TEdit box clearly indicates that the form visible property is false - yet I am reading the TEdit box contents as it IS visible on the screen. This should never happen.