PeterBelow

23 hours ago, Mike Torrettinni said:

That's interesting. From all the stuff that you can sue/get sued in US, also usually about the software the issue is late/non delivery, extra charges, quality... but, I've never heard of a case like this. Do you have any links about such case? What was the actual lawsuit about, what kind of the damage was caused? What country was that?

I don't know much about the US legal system, other than that it is weird by german standards and have no actual case I could point to. But in my opinion a known safety problem like the one this discussion is about would be a quality issue. Of course if the client decides to use such an unsafe installation folder and the possible risk is spelled out in the installation guide then it is his problem.

As far as I'm aware  (and i'm definitely not a lawyer) in Germany software is treated like other products (hardware) now as far as consumer protection legislation and liability is concerned, so damage caused by faulty software could be reason for a (private) lawsuite. In this particular case it would probably boil down to how much knowlege of the risk involved can be reasonably expected of the user installing the software...

22 hours ago, dummzeuch said:

Yes, I'm aware of that.

Are you also aware of the legal repercussions that may have? It's of course OK if you only use the program on your own computers, but if you sell it to clients it opens you up to litigation. If the program is infected on the client's computer and then causes damage there the client could sue you, since the program does not follow accepted safety standards for software. Depends on your countries legislation, of course.

16 hours ago, dummzeuch said:

That depends. Our internal programs all do that. They aren't installed under program files, though.

That requires write access for the user account to the folder the program is in, and that makes it vulnerable to malware attacks.

17 hours ago, Michael Riley said:

Thank you. I did a fresh install of Delphi Professional and the only FireDAC source files I see are:

FireDAC.Phys.pas

FireDAC.Phys.SQLGenerator.pas

FireDAC.Phys.SQLPreprocessor.pas

 

I don't understand why my Delphi 10.4 install has all the FireDAC source files.

I just checked my Pro installations and both 10.4 and 11.1 only have the three source files you listed. For the other FireDac units only the DCUs are there.

The latest Feature Matrix lists full FireDac source code as Enterprise /Architect edition only.

14 hours ago, Attila Kovacs said:

I have an app which downloads table data's from a server with CleverComponents + OmniThreadLibrary. Data is json, zipped, encoded. All CPU is used for downloading and importing the data into an SQL server.

 

Here are some results with FastMM 4 (default) vs. 5 using Berlin U2.

 

32bit FastMM4 Sync done in 138,29 Sec
32bit FastMM5 Sync done in 106,903 Sec

64bit FastMM4 Sync done in 144,357 Sec
64bit FastMM5 Sync done in 107,587 Sec

 

I was shocked by these numbers so I thought I'm sharing my experience.

 

What's so shocking about these numbers?

22 hours ago, João Bosco said:

I'm using the "SSH_Pascal" library and creating an SSH connection via delphi.

After a lot of effort I discovered that it is necessary to have your RSA key and your host in this file called "known_hosts" in windows it is usually at: %USERPROFILE% + .ssh\known_hosts

To create an RSA key using openSSH via CMD is simple, see the command:

ssh-keyscan -t rsa your host

There, your RSA key is created.

The only difficulty I'm having is getting this RSA via cmd and adding it to the file.

the simplest way through cmd would be: ssh-keyscan -t rsa your host > %USERPROFILE% + .ssh\known_hosts To insert the value into the file.

But using by delphi is not working.

 

Redirection is function of the command processor. The easiest way to use it from a Delphi program is to write the commnd line with the redirection to a batch file (.bat or .cmd) and then simply run that via ShellExcecute, IMO.

 

 

Works fine for me as well, D11.1 on Win10. Does your source file use an encoding other than ANSI?

16 minutes ago, limelect said:

@Der schöne Günther 2 lines this is the INI

 

Crazy as it sounds I gave a full path I got yes

then I deleted the full path I got yes.

Well now I am buffeled 

Is it Delphi that gives me a beautiful day? 

 

What I think there might have been hidden characters although no reason for it

 

 
 

If you don't use a full path the program will look for the file in whatever it considers to be the "current directory" at the moment. That can depend on many things, e.g. on how you start the program, and it can even change during the program run, e.g. by using a file dialog. If you do want to keep your sanity (and control of the situation) always use full pathes. A program should use a specific folder for its files, e.g. one created under TPath.GetDocumentsPath or TPath.GetHomePath.

15 hours ago, Stéphane Wierzbicki said:

Well, web installation did work. IDE is running but i'm facing issues with GetIt.

 

GetIt is able to display, filter items but as soon as I click the Install button I'm getting errors (I'm no more at the office now but from memory it was related to network connectivity issue)

 

I suspect our proxy to be too strict... this is only guessing as Embarcadero isn't providing any info about installing Rad Studio in a "secured" network environment.

 

 

I had to do that at work (before retirement a couple of years ago) since the web installer was unable towork through our firewall. Just downloading the ISO and running the installer from that worked for me.

17 hours ago, JDRenk said:

Thanks, I now have that Com Port and sensor working OK.  Now I have another sensor and Com Port that are totally different.  This one returns a 4 byte float32_t value.  I have the 4 bytes in an array of bytes.  How would I convert that to a decimal string?

That would be the equivalent of a Delphi Single. Use the good old Move procedure to copy the 4 bytes to a Single variable and pass that to FormatFloat to get a string representation.

2 minutes ago, chkaufmann said:

I create a handler where I want to subscribe / unsubscribe consumers:

type
  TBSEvent<T> = reference to procedure(const obj: T);

  IBSRemoteMessageController = interface
  ['{1C7ECC50-3CA2-41A0-B230-0E9FE4CF9BE4}']
    procedure Subscribe(AHandler: TBSEvent<IBSRemoteMessage>);
    procedure Unsubscribe(AHandler: TBSEvent<IBSRemoteMessage>);
  end;

Now in my implementation of IBSRemoteMessageController I keep a list of these events. Unfortunately it looks like when I try to Unsubscribe() I get a different pointer even if I pass the same method.

The only solution I see here is, that I return a key with the Subscribe() method and then pass this key to Unsubscribe(). Or is there a different solution for this problem?

 

Regards
Christian

If I understand this correctly a "reference to procedure" type is implemented by the compiler as a hidden class with an interface that contains the actual method called when the referenced method is called through this reference. On the point where you pass the reference the compiler creates an instance of the class and uses it to store all captured variables the method refers to. In your case that happens two times, at the point where you call Subscribe and again when you call Unsubscribe, so you get two different instances of the hidden class passed to your methods (actually you get interface references, not object references).

I have no idea whether this will work, but since you can cast an interface reference to an object reference to get the object implementing the interface do that on the aHandler and compare the Classtype of that object with the one obtained from the stored handler in the same manner.

1 minute ago, EugeneK said:

Hi

 

Can anyone login to quality.embarcadero.com? It stopped letting me in, even though I can login to my.embarcadero.com with the same credentials

Failss for me as well.

Play with this unit, it seems to do what you want, at least with the kind of input you showed.

unit SqlLogParserU;

interface

uses
  System.Classes, System.Generics.Collections;

type
  TStatementParts = record
    Fieldlist, FromList, WhereClause, OrderAndGrouping: string;
  end;

  TColumnDigest = class(TObject)
  strict private
    FName: string;
    FValues: TStringList;
  public
    constructor Create(const AName: string);
    destructor Destroy; override;
    property Name: string read FName;
    property Values: TStringList read FValues;
  end;

  TColumnDigestList = class(TObjectDictionary<string, TColumnDigest>)
  end;

  TSqlStatementDigest = class(TObject)
  strict private
  const
    CRegEx = '([_\d\w]+)\s*([=<>]+)\s*(''.+''|[\d.+\-]+)';
  var
    FColumns: TColumnDigestList;
    FOccurences: Integer;
    FParts: TStatementParts;
    function GetColumnlist: string;
    function GetStatement: string;
    procedure NormalizeWhereClause;
  strict protected
    function GetReportItem: string;
    property Columns: TColumnDigestList read FColumns;
  public
    constructor Create(const AParts: TStatementParts);
    destructor Destroy; override;
    procedure AddColumnValue(const aColumn, aValue: string);
    procedure AnalyzeWhereclause(const aClause: string);
    procedure IncOccurences;
    property Occurences: Integer read FOccurences;
    property ReportItem: string read GetReportItem;
  end;

  TDigestList = class(TObjectDictionary<string, TSqlStatementDigest>)
  end;

  TLogSqlParser = class(TObject)
  strict private
    FDigestList: TDigestList;
  strict protected
    procedure AnalyzeAndLogStatement(const aParts: TStatementParts);
    procedure DigestStatement(const aLine: string);
    procedure DissectStatement(const aLine: string; var aParts: TStatementParts);
    procedure HandleOrderAndGrouping(var aParts: TStatementParts);
    function IsSelectStatement(const aLine: string): Boolean;
    function GetReport: string;
    property DigestList: TDigestList read FDigestList;
  public
    constructor Create; reintroduce; virtual;
    destructor Destroy; override;
    procedure Analyze(const aLogText: string); overload;
    procedure Analyze(aText: TStrings); overload;
    property Report: string read GetReport;
  end;


implementation

uses
  Sysutils, System.RegularExpressions;

{== TLogSqlParser =====================================================}

constructor TLogSqlParser.Create;
begin
  inherited Create;
  FDigestList := TDigestList.Create([doOwnsValues]);
end;

destructor TLogSqlParser.Destroy;
begin
  FDigestList.Free;
  inherited Destroy;
end;

procedure TLogSqlParser.Analyze(const aLogText: string);
var
  LText: TStringList;
begin
  LText := TStringList.Create();
  try
    LText.Text := aLogText;
    Analyze(LText);
  finally
    LText.Free;
  end;
end;

procedure TLogSqlParser.Analyze(aText: TStrings);
var
  I: Integer;
begin
  DigestList.Clear;
  for I := 0 to aText.Count-1 do
    DigestStatement(aText[I]);
end;

procedure TLogSqlParser.AnalyzeAndLogStatement(const aParts: TStatementParts);
var
  LDigest: TSqlStatementDigest;
begin
  if not Digestlist.TryGetValue(aParts.Fieldlist, LDigest) then begin
    LDigest := TSqlStatementDigest.Create(aParts);
    DigestList.Add(aParts.Fieldlist, LDigest);
  end;
  LDigest.IncOccurences;
  LDigest.AnalyzeWhereclause(aParts.WhereClause);
end;

procedure TLogSqlParser.DigestStatement(const aLine: string);
var
  LParts: TStatementParts;
begin
  if IsSelectStatement(aLine) then begin
    DissectStatement(aLine.Trim.ToLower, LParts);
    if not LParts.Fieldlist.IsEmpty then
      AnalyzeAndLogStatement(LParts);
  end; {if}
end;

procedure TLogSqlParser.DissectStatement(const aLine: string; var aParts:
    TStatementParts);
const
  CRegEx =
    'select (.*) from (.*) where (.*)';
var
  LMatch: TMatch;
begin
  LMatch := TRegEx.Match(aLine, CRegEx, [roSingleLine]);
  if LMatch.Success then begin
    aParts.Fieldlist := LMatch.Groups[1].Value;
    aParts.FromList := LMatch.Groups[2].Value;
    aParts.WhereClause := LMatch.Groups[3].Value;
    HandleOrderAndGrouping(aParts);
  end {if}
  else
    Finalize(aParts);
end;

function TLogSqlParser.GetReport: string;
var
  LReport: TStringList;
  I: Integer;
  LDigest: TSqlStatementDigest;
begin
  LReport := TStringList.Create();
  for LDigest in DigestList.Values do begin
    LReport.Add(LDigest.ReportItem);
  end; {for}

  Result := LReport.Text;
end;

procedure TLogSqlParser.HandleOrderAndGrouping(var aParts: TStatementParts);
const
  CGroupBy = ' group by ';
  COrderBy = ' order by ';
  // SQL requires grouping before ordering!
  CBoundaries: array [0..1] of string = (CGroupBy, COrderBy);
var
  I: Integer;
  LParts: TArray<string>;
  S: string;
begin
  S:= aParts.WhereClause;
  aParts.OrderAndGrouping := string.empty;
  for I := Low(CBoundaries) to High(CBoundaries) do
    if S.Contains(CBoundaries[I]) then begin
       LParts := S.Split([CBoundaries[I]]);
       aParts.WhereClause := LParts[0];
       aParts.OrderAndGrouping := CBoundaries[I] + LParts[1];
       Break;
    end; {if}
end;

function TLogSqlParser.IsSelectStatement(const aLine: string): Boolean;
begin
  Result := aLine.Trim.StartsWith('select ', true);
end;

{== TSqlStatementDigest ===============================================}

constructor TSqlStatementDigest.Create(const AParts: TStatementParts);
begin
  inherited Create;
  FParts := AParts;
  NormalizeWhereClause;
  FColumns := TColumnDigestList.Create([doOwnsValues]);
end;

destructor TSqlStatementDigest.Destroy;
begin
  FColumns.Free;
  inherited Destroy;
end;

procedure TSqlStatementDigest.AddColumnValue(const aColumn, aValue: string);
var
  LColumn: TColumnDigest;
begin
  if not Columns.TryGetValue(aColumn, LColumn) then begin
    LColumn := TColumnDigest.Create(aColumn);
    Columns.Add(aColumn, LColumn);
  end;
  LColumn.Values.Add(aValue);
end;

procedure TSqlStatementDigest.AnalyzeWhereclause(const aClause: string);
var
  LMatch: TMatch;
begin
  LMatch := TRegEx.Match(aClause, CRegEx);
  while LMatch.Success do begin
     AddColumnValue(LMatch.Groups[1].Value, LMatch.Groups[3].Value);
     LMatch := LMatch.NextMatch;
  end; {while}
end;

function TSqlStatementDigest.GetColumnlist: string;
var
  LColumn: TColumnDigest;
  LText: TStringList;
begin
  LText := TStringList.Create();
  for LColumn in Columns.Values  do
    LText.Add(
      Format('  Column: %s, values: [%s]',[LColumn.Name, LColumn.Values.CommaText]));
  Result := LText.Text;
end;

function TSqlStatementDigest.GetReportItem: string;
const
  CMask = 'Sql statement: %s'+SLineBreak+
    '  occurrence: %d'+SLineBreak+
    '%s';
begin
  Result := Format(CMask,[GetStatement, Occurences, GetColumnlist]);
end;

function TSqlStatementDigest.GetStatement: string;
begin
  Result := Format('select %s from %s where %s %s',
    [FParts.Fieldlist, FParts.FromList, FParts.WhereClause, FParts.OrderAndGrouping]);
end;

procedure TSqlStatementDigest.IncOccurences;
begin
    Inc(FOccurences);
end;

procedure TSqlStatementDigest.NormalizeWhereClause;
const
  CSpace = ' ';
  CSingleQuote = '''';
var
  LMatch: TMatch;
  S: string;
  LBuilder: TStringbuilder;
  LParts: TArray<string>;
  I: Integer;
begin
  S := FParts.WhereClause;
  LMatch := TRegEx.Match(S, CRegEx);
  if LMatch.Success then begin
    LBuilder:= TStringbuilder.Create;
    try
      while LMatch.Success do begin
        for I := 1 to 3 do begin
          {1: column name, 2: operator, 3: value}
          LParts := S.Split([LMatch.Groups[I].Value], 2);
          if I < 3 then begin
            LBuilder.Append(LParts[0]);
            LBuilder.Append(LMatch.Groups[I].Value);
          end {if}
          else begin
            if LParts[0].Contains(CSingleQuote) then
              LBuilder.Append(CSingleQuote + '?' + CSingleQuote)
            else
              LBuilder.Append('?');
          end; {else}
          LBuilder.Append(CSpace);
          S:= LParts[1];
        end; {for }

        LMatch := LMatch.NextMatch;
      end;
      FParts.WhereClause := LBuilder.ToString;
    finally
      LBuilder.Free;
    end;
  end; {if}
end;

{== TColumnDigest =====================================================}

constructor TColumnDigest.Create(const AName: string);
begin
  inherited Create;
  FName := AName;
  FValues := TStringList.Create;
  FValues.Duplicates := dupIgnore;
  FValues.Sorted := true;
end;

destructor TColumnDigest.Destroy;
begin
  FValues.Free;
  inherited Destroy;
end;

end.

SqlLogParserU.pas

7 hours ago, dummzeuch said:

I remember that for one particular Delphi version there was a hidden Code Insight option to automatically fill in the parameters for a function call.

 

What I mean by that is, given a function declared as

function bla(FirstParam, SecondParam: integer; out ThirdParam: string): byte;

when you enter a call to it in the editor

MyVar := bla( 

and press some hotkey, the function call would be automatically completed as

 MyVar := bla(FirstParam, SecondParam, ThirdParam);

I don't mean the hint on parameters that is still available, but actually adding this text into the editor.

To enable this, you needed to set a particular registry key.

This was only possible in one particular Delphi version (2006?) and was removed in the next version.

If I remember correctly some Borland (Inprise / Codegear ?) employee blogged about it.

 

Does anybody remember the specifics?

I don't think that ever existed. If it did it would be completely useless since the actual variables you pass to a function call are rarely (in my case never ) named the same as the parameters in the function declaration.

18 hours ago, JDRenk said:

Ok, I have a better handle on this. Since I am getting data back from different sensors via 3 UARTs, I found the best way for all is to read an ANSIString or byte by byte into a buffer.  The data contains other information I need to discard.  So how would I select characters i->j out of k total?     "xxxxxxxxixxxxxxjxxxxxxxxxxk"

Thanks,  Jeff

You never told us which Delphi version you are using. If it has a System.Ansistrings unit:  that contains a number of routines to work with ansistrings. Use the AnsiPos function to search for a character or substring; it returns the index of the found item. Use AnsiMidStr to extract a range of characters from an Ansistring (or the good old Copy function, it has an overload for Ansistrings).

4 hours ago, david_navigator said:

I have a two sets of datetimes which I need to frequently check to see if the two lists are identical. There isn't the time to iterate through the lists whenever I need this info, so I'm thinking I need to store a value that represents the data.
I think it's a hash, but this isn't something I've done before and everything I've attempted hasn't worked i.e I've changed some of the datetimes and ended up with the same result.

 

If it's relevant there are usually about 60 in each set, but it could be between two and a thousand (always an even number) and each is only stored to the minute i.e seconds & mS are always zero.

 

Can anyone point me in the correct direction please ?

 

Many thanks

 

David

Since you only need to be precise to the minute do not store TDatetimes but multiply the values by 60*24 and truncate the result to give an integer (perhaps an int64, you could reduce the range necessary by subtracting a suitable reference date first, e.g. EncodeDate(2020,1,1)). This gives you the number of minutes from the reference date. Store these into a TList<integer>. To calculate a hash use the list's ToArray method to get an array you can feed to a suitable hash algorithm from the System.Hash unit.

14 hours ago, AlexQc said:

The thread is created when the user click a button or when he drag and drop files/directory to the form so yes at that point the TListBox (ListBoxPrograms) is fully created. Since I use a "plain" Delphi TListBox I guess I'm OK? (At least it's working fine here). The thread don't know nothing about the Form (it only receive the TStrings from the form TListBox.Items).

 

It is working in this case since TListboxStrings.Add (TListboxStrings is the TStrings descendant behind TListbox.Items) does indeed send a message (LB_ADDSTRING) to the control, and the control is visible on the form. But you should not rely on such implementation details when working in a background thread.

Using Synchronize the pattern would be something like this:

Synchronize(
  procedure
  begin
    Buffer.Add(LCurrentFile);
  end);

where LCurrentfile is the local variable holding the filename to add to the listbox. The code goes inside your find loop.

Quote

I'm back to coding Windows applications and I'm using Delphi 10.4. Everything is working: no memory leak, no race conditions, no deadlocks... I'm pretty sure everything is OK but since it's my first time (seriously) using TThread in a Windows application I want to double check that I didn't do something bad!

Code simplified for readability:

I see a few problems with your code.

In general you cannot access UI controls from a background thread, but you pass ListBoxPrograms.Items as the Buffer parameter to the thread's constructor. This can work if the Add method of ListBoxPrograms.Items is implemented by sending a message to the listbox control, since the OS makes sure a message is delivered in the thread that created the control's window handle. On the other hand the VCL creates a control handle on an as needed basis, and if the ListBoxPrograms.Handle has not been created yet when the thread tries to add the first item the handle would be created in the background thread context, which would not work since this thread has no message loop.

So: Always access UI controls only in a Synchronized or Queued method! You did not show code for the ListFilesDir method, so perhaps you are doing that already.

The second point to investigate is how to safely interrupt the thread's work if it has to be killed before it has completed its work. The TThread Destructor calls Terminate and then waits for the thread to die gracefully (by leaving the Ececute method). For this to work as expected the thread's work loop has to check the Terminated property on each round and exit directly if it is true. Again this is something you would do in ListFilesDir.

Then there is the question of error handling in the thread's work loop. The usual pattern is to wrap the whole body of the Execute method in a try except block and either pass a trapped exception to the main thread for reporting to the user via a Synchronized method (not a queued one!), or use the Windows.MessageBox function to report it directly. That API is thread-safe, while the VCL.Dialogs methods are not.

7 hours ago, MathewV said:

Is anyone else having issues where you step into a DLL function and all you get is the CPU screen?

 

There are so many reasons why we want to move our 25 year Delphi project to D11, but this one is stopping us and there has been no traffic on the RSP that has been added (https://quality.embarcadero.com/browse/RSP-35879)

I recorded a video here https://www.screencast.com/t/qEOV7MO00Jq and you can download the OP's sample project from the RSP. 

 

If this is a user/setting error, please let me know! 

I have not been working with DLL projects much in the past and never with 64 bit DLLs, but usually one had to debug the DLL project, set the host application to use in the Run -> Parameters dialog, set a breakpoint in the DLL funtion of interest, and then just run. Do the required actions in the host to end up in the DLL at the breakpoint.

If you end up in the CPU view this means that the debugger cannot find the debug information for the code you stepped into. Make sure you build the DLL with debug information. 64-bit apps are debugged in a kind of remote debugger session since the IDE is a 32 bit process. So make sure you have enabled "include remote debug symbols" in the linker options.

18 hours ago, Attila Kovacs said:

This will only work if you have the sources for every components you are using and you also build them all at least once at building the release version aaaand your units will be found earlier than the dcu's in Delphi's lib directory.

 

So it wasn't for me, I'm using this:

...

 

 

Was it originaly from you @PeterBelow?  http://www.delphigroups.info/2/92/298063.html

 

Yes. That was ages ago, makes me realize how old I've gotten now...

 

8 hours ago, Remy Lebeau said:

This is why you should configure your AntiVirus/AntiMalware to ignore compiler output folders as exceptions.

 

If I only could; McAfee rermoved that ability some years ago, one can only exempt specific EXEs now, and that is automatically removed if the EXE changes. I would not recomment McAfee for developer PCs for this reason, although it is a good product otherwise, IMO (a bit pricey, though). I can live with it since I don't program for a living and these false detections are rare.

2 minutes ago, Dirk Janssens said:

That is how it works for my simpel project, but for the more complex one I see not why it does not work.
Can it be that the cause is that I name the unit "Consts.pas", and not "VCL.consts.pas" ? 

 

Definitely. It will also not work if you build your project with runtime packages.

Can't you read it one byte at a time? I'm not familiar with the component you use.

20 hours ago, stan rydzewski said:

Greetings.  

 

I briefly used Delphi at a job I had a few years ago.   Well just this week I had a desire to create some simple windows forms programs for personal use.  Seeking to avoid the overhead of .net,  I thought of Delphi. 

I downloaded the community edition and created a quick 'hello world' sort of program as a proof of concept.  I made an exe of it which seems to run fine from explorer. 

 

I went to send it to myself via gmail to see if I could run it on a machine that didn't have delphi installed.  gmail immediately flagged it as a virus! 

 

I had a similar problem with Delphi Alexandria, McAfee would detect a freshly build Win32 debug EXE as virus and quarantine it before I could debug it under the IDE, but it would not flag the 32 bit release version of the same program and neither 64 bit debug or release versions.

By the way: to send an EXE through a mail server put it into a ZIP file and password-protect that. The encryption done will make a virus scanner ignore it since it cannot identify the zipped file as executable. Some particularly paranoid mail servers will reject password-protected zip files for this reason, though.

You can use the OnDrawCell event to draw the cell content yourself any way you like. The stringgrid.Canvas has a TextRect method that supports aligning the text in the way you want.