I'm working in trying to display some old SWF files with Direct2D.
I found swfmill which, for a simple SWF (found here) that displays a "W"
produces XML code, part of which is this one:
<ShapeSetup x="-214" y="470" fillStyle1="1"/>
<LineTo x="-20" y="0"/>
<CurveTo x1="-35" y1="-74" x2="-45" y2="-109"/>
<CurveTo x1="-46" y1="-109" x2="-109" y2="-244"/>
<CurveTo x1="-110" y1="-244" x2="-32" y2="-50"/>
<CurveTo x1="-33" y1="-50" x2="-27" y2="-18"/>
<CurveTo x1="-27" y1="-19" x2="-21" y2="-3"/>
<CurveTo x1="-21" y1="-1" x2="0" y2="-9"/>
<CurveTo x1="0" y1="-10" x2="53" y2="0"/>
<LineTo x="304" y="0"/>
<CurveTo x1="43" y1="0" x2="0" y2="10"/>
<CurveTo x1="0" y1="10" x2="-24" y2="0"/>
<CurveTo x1="-100" y1="6" x2="0" y2="70"/>
<CurveTo x1="0" y1="16" x2="8" y2="27"/>
<CurveTo x1="8" y1="27" x2="100" y2="229"/>
<CurveTo x1="99" y1="229" x2="59" y2="120"/>
<CurveTo x1="22" y1="-56" x2="73" y2="-216"/>
<CurveTo x1="72" y1="-215" x2="14" y2="-56"/>
<CurveTo x1="-53" y1="-131" x2="-24" y2="-21"/>
<CurveTo x1="-24" y1="-22" x2="-41" y2="-7"/>
<CurveTo x1="-29" y1="-1" x2="0" y2="-9"/>
<CurveTo x1="0" y1="-10" x2="52" y2="0"/>
<LineTo x="305" y="0"/>
<CurveTo x1="28" y1="0" x2="7" y2="2"/>
<CurveTo x1="8" y1="2" x2="0" y2="6"/>
<CurveTo x1="0" y1="6" x2="-40" y2="4"/>
<CurveTo x1="-84" y1="13" x2="0" y2="68"/>
<CurveTo x1="0" y1="106" x2="234" y2="531"/>
<CurveTo x1="46" y1="-116" x2="44" y2="-123"/>
<LineTo x="80" y="-220"/>
<CurveTo x1="35" y1="-97" x2="4" y2="-25"/>
<CurveTo x1="5" y1="-25" x2="0" y2="-21"/>
<CurveTo x1="0" y1="-89" x2="-85" y2="-2"/>
<CurveTo x1="-19" y1="0" x2="0" y2="-10"/>
<CurveTo x1="0" y1="-6" x2="6" y2="-2"/>
<CurveTo x1="6" y1="-2" x2="28" y2="0"/>
<LineTo x="165" y="0"/>
<CurveTo x1="74" y1="0" x2="10" y2="2"/>
<CurveTo x1="11" y1="1" x2="0" y2="9"/>
<CurveTo x1="0" y1="8" x2="-16" y2="0"/>
<CurveTo x1="-74" y1="6" x2="-43" y2="83"/>
<CurveTo x1="-42" y1="83" x2="-154" y2="449"/>
<CurveTo x1="-81" y1="235" x2="-27" y2="64"/>
<LineTo x="-21" y="0"/>
<CurveTo x1="-58" y1="-160" x2="-55" y2="-132"/>
<CurveTo x1="-54" y1="-132" x2="-100" y2="-257"/>
<LineTo x="-229" y="681"/>
<ShapeSetup/>
I'm not sure how to interpret this shape.
What I've tried:
I tried with a ID2D1PathGeometry and BeginFigure (for the ShapeSetup),
AddLine (for each LineTo),
AddQuadraticBezier (for each CurveTo) but the result is this:
I realized that I must combine some geometries but I'm not sure how. A spec I found here says:
FillStyle0 and FillStyle1 The Adobe Flash authoring tool supports two fill styles per edge, one for each side of the edge: FillStyle0 and
FillStyle1.
For shapes that don’t self-intersect or overlap,
FillStyle0 should be used.
For overlapping shapes the situation is more complex. For example, if a shape consists of two overlapping squares, and only FillStyle0 is defined, Flash Player renders a ‘hole’ where the paths overlap. This area can be filled using FillStyle1. In this situation, the rule is that for any directed vector, FillStyle0 is the color to the left
of the vector, and FillStyle1 is the color to
the right of the vector
Is there anyone that understands how that shape should be drawn?
Probably, coordinates are all relative. So you need to calculate positions incrementally.
For example,
<ShapeSetup x="-214" y="470" fillStyle1="1"/>
<LineTo x="-20" y="0"/>
<CurveTo x1="-35" y1="-74" x2="-45" y2="-109"/>
:
are to be translated to
pSink->BeginFigure(D2D1::Point2F(-214, 470), D2D1_FIGURE_BEGIN_FILLED);
pSink->AddLine(D2D1::Point2F(-234, 470)); // -214, 470 + (-20, 0)
D2D1_QUADRATIC_BEZIER_SEGMENT seg = {
D2D1::Point2F(-269, 396), // -234, 470 + (-35,-74)
D2D1::Point2F(-314, 287) // -269, 396 + (-45,-109)
};
pSink->AddQuadraticBezier(&seg);
:
Appendix
Testing it in XAML or SVG path-data form,
M -214,470
l -20, 0
q -35,-74 -80,-183
q -46,-109 -155,-353
q -110,-244 -142,-294
q -33,-50 -60,-68
q -27,-19 -48,-22
q -21,-1 -21,-10
q 0,-10 53,-10
l 304, 0
q 43,0 43,10
q 0,10 -24,10
q -100,6 -100,76
q 0,16 8,43
q 8,27 108,256
q 99,229 158,349
q 22,-56 95,-272
q 72,-215 86,-271
q -53,-131 -77,-152
q -24,-22 -65,-29
q -29,-1 -29,-10
q 0,-10 52,-10
l 305, 0
q 28,0 35,2
q 8,2 8,8
q 0,6 -40,10
q -84,13 -84,81
q 0,106 234,637
q 46,-116 90,-239
l 80, -220
q 35,-97 39,-122
q 5,-25 5,-46
q 0,-89 -85,-91
q -19,0 -19,-10
q 0,-6 6,-8
q 6,-2 34,-2
l 165, 0
q 74,0 84,2
q 11,1 11,10
q 0,8 -16,8
q -74,6 -117,89
q -42,83 -196,532
q -81,235 -108,299
l -21, 0
q -58,-160 -113,-292
q -54,-132 -154,-389
l -229, 681
Z
surely got W.
I have a requirement where I need to create a csv file using xslt 1.0/2.0.
In below Source XML - For each complex type element inside <Effective_Change>, In this case it is <Worker_Status> I need to create a row for each child element inside complex type element.
<?xml version="1.0" encoding="UTF-8"?>
<peci:Workers_Effective_Stack xmlns:peci="urn:com.w/peci">
<peci:Worker>
<peci:Summary>
<peci:Integration_Event>14d964101fdb0156e164341b45548d01</peci:Integration_Event>
<peci:Integration_Sent_On>2018-05-10T08:41:39.375-07:00</peci:Integration_Sent_On>
<peci:Payroll_Company_Name>West Brooke - Biweekly: B</peci:Payroll_Company_Name>
<peci:Pay_Group_Country>US</peci:Pay_Group_Country>
</peci:Summary>
<peci:Worker>
<peci:Worker_Summary>
<peci:WID>rd</peci:WID>
<peci:Employee_ID>33333</peci:Employee_ID>
<peci:Name>Test 1</peci:Name>
</peci:Worker_Summary>
<peci:Effective_Change peci:Sequence="0">
<peci:Derived_Event_Code>DTA</peci:Derived_Event_Code>
<peci:Effective_Moment>2018-05-10T08:29:21.235-07:00</peci:Effective_Moment>
<peci:Entry_Moment>2018-05-10T08:29:21.235-07:00</peci:Entry_Moment>
<peci:Worker_Status>
<peci:Status>Active</peci:Status>
<peci:Active>1</peci:Active>
<peci:Active_Status_Date>2018-01-08-08:00</peci:Active_Status_Date>
<peci:Terminated>0</peci:Terminated>
<peci:Hire_Date>2018-01-08-08:00</peci:Hire_Date>
<peci:Original_Hire_Date>2018-01-08-08:00</peci:Original_Hire_Date>
<peci:Is_Rehire>0</peci:Is_Rehire>
<peci:Continuous_Service_Date>2018-01-08-08:00</peci:Continuous_Service_Date>
<peci:First_Day_of_Work>2018-01-08-08:00</peci:First_Day_of_Work>
<peci:Seniority_Date>2018-01-08-08:00</peci:Seniority_Date>
</peci:Worker_Status>
</peci:Effective_Change>
<peci:Effective_Change peci:Sequence="1">
<peci:Derived_Event_Code>DTA</peci:Derived_Event_Code>
<peci:Effective_Moment>2018-05-10T08:31:27.880-07:00</peci:Effective_Moment>
<peci:Entry_Moment>2018-05-10T08:31:27.880-07:00</peci:Entry_Moment>
<peci:Worker_Status>
<peci:Status>Active</peci:Status>
<peci:Active>1</peci:Active>
<peci:Active_Status_Date>2018-01-08-08:00</peci:Active_Status_Date>
<peci:Terminated>0</peci:Terminated>
<peci:Hire_Date>2018-01-08-08:00</peci:Hire_Date>
<peci:Original_Hire_Date>2018-01-08-08:00</peci:Original_Hire_Date>
<peci:Is_Rehire>0</peci:Is_Rehire>
<peci:Continuous_Service_Date>2018-01-08-08:00</peci:Continuous_Service_Date>
<peci:First_Day_of_Work>2018-01-08-08:00</peci:First_Day_of_Work>
<peci:Seniority_Date>2018-01-08-08:00</peci:Seniority_Date>
</peci:Worker_Status>
</peci:Worker>
</peci:Workers_Effective_Stack>
<?xml version='1.0' encoding='UTF-8'?>
<peci:Workers_Effective_Stack xmlns:peci="urn:com.workday/peci">
<peci:Summary>
<peci:Payroll_Company_ID>Test Company</peci:Payroll_Company_ID>
<peci:Payroll_Company_Name>Test Company</peci:Payroll_Company_Name>
<peci:Pay_Group_ID>Monthly</peci:Pay_Group_ID>
<peci:Pay_Group_Name>Test</peci:Pay_Group_Name>
<peci:Pay_Group_Country>SE</peci:Pay_Group_Country>
<peci:Pay_Group_Code>3</peci:Pay_Group_Code>
<peci:Pay_Period_Start>2017-03-01-03.34</peci:Pay_Period_Start>
<peci:Pay_Period_End>2017-03-30-03.34</peci:Pay_Period_End>
<peci:Updated_From>2017-03-10T07:56:16.000-03.34</peci:Updated_From>
<peci:Updated_To>2017-03-19T09:06:13.769-03.34</peci:Updated_To>
<peci:Effective_From>2017-03-01-03.34</peci:Effective_From>
<peci:Effective_To>2017-03-30-03.34</peci:Effective_To>
<peci:Change_Detection>Test</peci:Change_Detection>
<peci:First_Primary_Run_of_Pay_Period>0</peci:First_Primary_Run_of_Pay_Period>
<peci:Ad_Hoc_Run>1</peci:Ad_Hoc_Run>
<peci:Full_Snapshot>0</peci:Full_Snapshot>
<peci:Worker_Count>1</peci:Worker_Count>
<peci:Version>1</peci:Version>
</peci:Summary>
<peci:Worker>
<peci:Worker_Summary>
<peci:WID>2232</peci:WID>
<peci:Employee_ID>1141</peci:Employee_ID>
<peci:Name>Andrew D Johnson</peci:Name>
</peci:Worker_Summary>
<peci:Effective_Change peci:Sequence="0">
<peci:Derived_Event_Code>HIR</peci:Derived_Event_Code>
<peci:Effective_Moment>2017-03-10T00:00:00.000-03.34</peci:Effective_Moment>
<peci:Entry_Moment>2017-03-11T04:51:00.632-03.34</peci:Entry_Moment>
<peci:Worker_Status peci:isUpdated="1">
<peci:Status peci:isAdded="1">Active</peci:Status>
<peci:Active peci:priorValue="0">1</peci:Active>
<peci:Active_Status_Date peci:isAdded="1">2017-03-10-03.34</peci:Active_Status_Date>
<peci:Terminated>0</peci:Terminated>
<peci:Hire_Date peci:isAdded="1">2017-03-10-03.34</peci:Hire_Date>
<peci:Original_Hire_Date peci:isAdded="1">2017-03-10-03.34</peci:Original_Hire_Date>
<peci:Hire_Rescinded>0</peci:Hire_Rescinded>
<peci:Is_Rehire>0</peci:Is_Rehire>
<peci:End_Employment_Date peci:isAdded="1">2021-05-31-03.34</peci:End_Employment_Date>
</peci:Worker_Status>
<peci:Personal peci:isUpdated="1">
<peci:Legal_Name peci:isAdded="1">
<peci:First_Name>Andrew</peci:First_Name>
<peci:Middle_Name>D</peci:Middle_Name>
<peci:Last_Name>Johnson</peci:Last_Name>
</peci:Legal_Name>
<peci:Workday_Account peci:isAdded="1">1141</peci:Workday_Account>
</peci:Personal>
<peci:Person_Communication peci:isUpdated="1">
<peci:Email peci:isAdded="1">
<peci:Usage_Type>HOME</peci:Usage_Type>
<peci:Email_Address>adjohnson#gmail.com</peci:Email_Address>
</peci:Email>
</peci:Person_Communication>
<peci:Person_Identification peci:isUpdated="1">
<peci:National_Identifier peci:isAdded="1">
<peci:National_ID>2037203020</peci:National_ID>
<peci:National_ID_Type>DL</peci:National_ID_Type>
</peci:National_Identifier>
</peci:Person_Identification>
<peci:Position peci:isAdded="1">
<peci:Worker_Type>Fixed_Term</peci:Worker_Type>
<peci:Position_Time_Type>Full_time</peci:Position_Time_Type>
<peci:Job_Exempt>0</peci:Job_Exempt>
<peci:Scheduled_Weekly_Hours>40</peci:Scheduled_Weekly_Hours>
<peci:Default_Weekly_Hours>40</peci:Default_Weekly_Hours>
<peci:Pay_Rate_Type>Salaried</peci:Pay_Rate_Type>
<peci:Job_Classification>
<peci:Job_Classification_Group>FT</peci:Job_Classification_Group>
<peci:Job_Classification_ID>232</peci:Job_Classification_ID>
</peci:Job_Classification>
<peci:Management_Level>AL1</peci:Management_Level>
<peci:Job_Category>TA</peci:Job_Category>
<peci:Business_Site>
<peci:Location_ID>CA_001</peci:Location_ID>
</peci:Business_Site>
<peci:Supervisor>
<peci:ID>1139</peci:ID>
<peci:Name>David Brown</peci:Name>
</peci:Supervisor>
<peci:Probation_Start_Date>2017-03-10-03.34</peci:Probation_Start_Date>
<peci:Probation_End_Date>2020-07-10-03.34</peci:Probation_End_Date>
</peci:Position>
<peci:Compensation peci:isAdded="1">
<peci:Compensation_Summary_in_Pay_Group_Frequency>
<peci:Total_Base_Pay>34000</peci:Total_Base_Pay>
<peci:Frequency>Yearly</peci:Frequency>
</peci:Compensation_Summary_in_Pay_Group_Frequency>
</peci:Compensation>
<peci:Compensation_Plans peci:isAdded="1">
<peci:Salary_and_Hourly_Plan>
<peci:Compensation_Plan>Base_Salary</peci:Compensation_Plan>
<peci:Amount>34000</peci:Amount>
<peci:Apply_FTE>1</peci:Apply_FTE>
<peci:Frequency>Yearly</peci:Frequency>
<peci:Start_Date>2017-03-10-03.34</peci:Start_Date>
</peci:Salary_and_Hourly_Plan>
</peci:Compensation_Plans>
<peci:Employee_Contract peci:isAdded="1">
<peci:Start_Date>2017-03-10-03.34</peci:Start_Date>
<peci:Contract_Status>Closed</peci:Contract_Status>
</peci:Employee_Contract>
<peci:Collective_Agreement peci:isAdded="1">
<peci:Collective_Agreement>No</peci:Collective_Agreement>
<peci:Collective_Agreement_Factor>
<peci:Factor>level</peci:Factor>
</peci:Collective_Agreement_Factor>
<peci:Collective_Agreement_Factor>
<peci:Factor>level</peci:Factor>
</peci:Collective_Agreement_Factor>
</peci:Collective_Agreement>
<peci:Additional_Information>
<peci:WorkerID>2232</peci:WorkerID>
</peci:Additional_Information>
</peci:Effective_Change>
<peci:Effective_Change peci:Sequence="1">
<peci:Derived_Event_Code>DTA</peci:Derived_Event_Code>
<peci:Effective_Moment>2017-03-11T00:00:00.000-03.34</peci:Effective_Moment>
<peci:Entry_Moment>2017-03-11T04:47:25.190-03.34</peci:Entry_Moment>
<peci:Person_Communication peci:isUpdated="1">
<peci:Address peci:isAdded="1">
<peci:Usage_Type>HOME</peci:Usage_Type>
<peci:Address_Line_1>Address_Line_1</peci:Address_Line_1>
<peci:City>City</peci:City>
<peci:Postal_Code>32323</peci:Postal_Code>
<peci:Country>US</peci:Country>
</peci:Address>
<peci:Email>
<peci:Usage_Type>HOME</peci:Usage_Type>
<peci:Email_Address>adjohnson#gmail.com</peci:Email_Address>
</peci:Email>
</peci:Person_Communication>
</peci:Effective_Change>
</peci:Worker>
</peci:Workers_Effective_Stack>
Outfile should have below format.
Derived_Event_Code,Effective_Moment,xml_element_name,xml_element_value
**Example output CSV file:**
DTA,2018-05-10,Status,Active
DTA,2018-05-10,Active,1
DTA,2018-05-10,Active_Status_Date,2018-01-08-08:00
DTA,2018-05-10,Terminated,0
DTA,2018-05-10,Hire_Date,2018-01-08-08:00
DTA,2018-05-10,Original_Hire_Date,2018-01-08-08:00
DTA,2018-05-10,Is_Rehire,0
DTA,2018-05-10,Continuous_Service_Date,0
DTA,2018-05-10,First_Day_of_Work,2018-01-08-08:00
DTA,2018-05-10,Seniority_Date,2018-01-08-08:00
DTA,2018-05-10,Status,Active
DTA,2018-05-10,Active,1
DTA,2018-05-10,Active_Status_Date,2018-01-08-08:00
DTA,2018-05-10,Terminated,0
DTA,2018-05-10,Hire_Date,2018-01-08-08:00
DTA,2018-05-10,Original_Hire_Date,2018-01-08-08:00
DTA,2018-05-10,Is_Rehire,0
DTA,2018-05-10,Continuous_Service_Date,0
DTA,2018-05-10,First_Day_of_Work,2018-01-08-08:00
DTA,2018-05-10,Seniority_Date,2018-01-08-08:00
Can someone suggest me how to achieve using xslt ?
Consider the following example:
XML
<peci:Workers_Effective_Stack xmlns:peci="urn:com.workday/peci">
<peci:Summary>
<peci:Payroll_Company_ID>Test Company</peci:Payroll_Company_ID>
<peci:Payroll_Company_Name>Test Company</peci:Payroll_Company_Name>
<peci:Pay_Group_ID>Monthly</peci:Pay_Group_ID>
<peci:Pay_Group_Name>Test</peci:Pay_Group_Name>
<peci:Pay_Group_Country>SE</peci:Pay_Group_Country>
<peci:Pay_Group_Code>3</peci:Pay_Group_Code>
<peci:Pay_Period_Start>2017-03-01-03.34</peci:Pay_Period_Start>
<peci:Pay_Period_End>2017-03-30-03.34</peci:Pay_Period_End>
<peci:Updated_From>2017-03-10T07:56:16.000-03.34</peci:Updated_From>
<peci:Updated_To>2017-03-19T09:06:13.769-03.34</peci:Updated_To>
<peci:Effective_From>2017-03-01-03.34</peci:Effective_From>
<peci:Effective_To>2017-03-30-03.34</peci:Effective_To>
<peci:Change_Detection>Test</peci:Change_Detection>
<peci:First_Primary_Run_of_Pay_Period>0</peci:First_Primary_Run_of_Pay_Period>
<peci:Ad_Hoc_Run>1</peci:Ad_Hoc_Run>
<peci:Full_Snapshot>0</peci:Full_Snapshot>
<peci:Worker_Count>1</peci:Worker_Count>
<peci:Version>1</peci:Version>
</peci:Summary>
<peci:Worker>
<peci:Worker_Summary>
<peci:WID>2232</peci:WID>
<peci:Employee_ID>1141</peci:Employee_ID>
<peci:Name>Andrew D Johnson</peci:Name>
</peci:Worker_Summary>
<peci:Effective_Change peci:Sequence="0">
<peci:Derived_Event_Code>HIR</peci:Derived_Event_Code>
<peci:Effective_Moment>2017-03-10T00:00:00.000-03.34</peci:Effective_Moment>
<peci:Entry_Moment>2017-03-11T04:51:00.632-03.34</peci:Entry_Moment>
<peci:Worker_Status peci:isUpdated="1">
<peci:Status peci:isAdded="1">Active</peci:Status>
<peci:Active peci:priorValue="0">1</peci:Active>
<peci:Active_Status_Date peci:isAdded="1">2017-03-10-03.34</peci:Active_Status_Date>
<peci:Terminated>0</peci:Terminated>
<peci:Hire_Date peci:isAdded="1">2017-03-10-03.34</peci:Hire_Date>
<peci:Original_Hire_Date peci:isAdded="1">2017-03-10-03.34</peci:Original_Hire_Date>
<peci:Hire_Rescinded>0</peci:Hire_Rescinded>
<peci:Is_Rehire>0</peci:Is_Rehire>
<peci:End_Employment_Date peci:isAdded="1">2021-05-31-03.34</peci:End_Employment_Date>
</peci:Worker_Status>
<peci:Personal peci:isUpdated="1">
<peci:Legal_Name peci:isAdded="1">
<peci:First_Name>Andrew</peci:First_Name>
<peci:Middle_Name>D</peci:Middle_Name>
<peci:Last_Name>Johnson</peci:Last_Name>
</peci:Legal_Name>
<peci:Workday_Account peci:isAdded="1">1141</peci:Workday_Account>
</peci:Personal>
<peci:Person_Communication peci:isUpdated="1">
<peci:Email peci:isAdded="1">
<peci:Usage_Type>HOME</peci:Usage_Type>
<peci:Email_Address>adjohnson#gmail.com</peci:Email_Address>
</peci:Email>
</peci:Person_Communication>
<peci:Person_Identification peci:isUpdated="1">
<peci:National_Identifier peci:isAdded="1">
<peci:National_ID>2037203020</peci:National_ID>
<peci:National_ID_Type>DL</peci:National_ID_Type>
</peci:National_Identifier>
</peci:Person_Identification>
<peci:Position peci:isAdded="1">
<peci:Worker_Type>Fixed_Term</peci:Worker_Type>
<peci:Position_Time_Type>Full_time</peci:Position_Time_Type>
<peci:Job_Exempt>0</peci:Job_Exempt>
<peci:Scheduled_Weekly_Hours>40</peci:Scheduled_Weekly_Hours>
<peci:Default_Weekly_Hours>40</peci:Default_Weekly_Hours>
<peci:Pay_Rate_Type>Salaried</peci:Pay_Rate_Type>
<peci:Job_Classification>
<peci:Job_Classification_Group>FT</peci:Job_Classification_Group>
<peci:Job_Classification_ID>232</peci:Job_Classification_ID>
</peci:Job_Classification>
<peci:Management_Level>AL1</peci:Management_Level>
<peci:Job_Category>TA</peci:Job_Category>
<peci:Business_Site>
<peci:Location_ID>CA_001</peci:Location_ID>
</peci:Business_Site>
<peci:Supervisor>
<peci:ID>1139</peci:ID>
<peci:Name>David Brown</peci:Name>
</peci:Supervisor>
<peci:Probation_Start_Date>2017-03-10-03.34</peci:Probation_Start_Date>
<peci:Probation_End_Date>2020-07-10-03.34</peci:Probation_End_Date>
</peci:Position>
<peci:Compensation peci:isAdded="1">
<peci:Compensation_Summary_in_Pay_Group_Frequency>
<peci:Total_Base_Pay>34000</peci:Total_Base_Pay>
<peci:Frequency>Yearly</peci:Frequency>
</peci:Compensation_Summary_in_Pay_Group_Frequency>
</peci:Compensation>
<peci:Compensation_Plans peci:isAdded="1">
<peci:Salary_and_Hourly_Plan>
<peci:Compensation_Plan>Base_Salary</peci:Compensation_Plan>
<peci:Amount>34000</peci:Amount>
<peci:Apply_FTE>1</peci:Apply_FTE>
<peci:Frequency>Yearly</peci:Frequency>
<peci:Start_Date>2017-03-10-03.34</peci:Start_Date>
</peci:Salary_and_Hourly_Plan>
</peci:Compensation_Plans>
<peci:Employee_Contract peci:isAdded="1">
<peci:Start_Date>2017-03-10-03.34</peci:Start_Date>
<peci:Contract_Status>Closed</peci:Contract_Status>
</peci:Employee_Contract>
<peci:Collective_Agreement peci:isAdded="1">
<peci:Collective_Agreement>No</peci:Collective_Agreement>
<peci:Collective_Agreement_Factor>
<peci:Factor>level</peci:Factor>
</peci:Collective_Agreement_Factor>
<peci:Collective_Agreement_Factor>
<peci:Factor>level</peci:Factor>
</peci:Collective_Agreement_Factor>
</peci:Collective_Agreement>
<peci:Additional_Information>
<peci:WorkerID>2232</peci:WorkerID>
</peci:Additional_Information>
</peci:Effective_Change>
<peci:Effective_Change peci:Sequence="1">
<peci:Derived_Event_Code>DTA</peci:Derived_Event_Code>
<peci:Effective_Moment>2017-03-11T00:00:00.000-03.34</peci:Effective_Moment>
<peci:Entry_Moment>2017-03-11T04:47:25.190-03.34</peci:Entry_Moment>
<peci:Person_Communication peci:isUpdated="1">
<peci:Address peci:isAdded="1">
<peci:Usage_Type>HOME</peci:Usage_Type>
<peci:Address_Line_1>Address_Line_1</peci:Address_Line_1>
<peci:City>City</peci:City>
<peci:Postal_Code>32323</peci:Postal_Code>
<peci:Country>US</peci:Country>
</peci:Address>
<peci:Email>
<peci:Usage_Type>HOME</peci:Usage_Type>
<peci:Email_Address>adjohnson#gmail.com</peci:Email_Address>
</peci:Email>
</peci:Person_Communication>
</peci:Effective_Change>
</peci:Worker>
</peci:Workers_Effective_Stack>
XSLT 1.0
<xsl:stylesheet version="2.0"
xmlns:xsl="http://www.w3.org/1999/XSL/Transform"
xmlns:peci="urn:com.workday/peci">
<xsl:output method="text"/>
<xsl:template match="/peci:Workers_Effective_Stack">
<xsl:for-each select="peci:Worker/peci:Effective_Change">
<xsl:variable name="common-data">
<xsl:value-of select="peci:Derived_Event_Code"/>
<xsl:text>,</xsl:text>
<xsl:value-of select="peci:Effective_Moment"/>
<xsl:text>,</xsl:text>
</xsl:variable>
<!-- for every leaf descendant -->
<xsl:for-each select="*//*[not(*)]">
<xsl:copy-of select="$common-data"/>
<xsl:value-of select="local-name()"/>
<xsl:text>,</xsl:text>
<xsl:value-of select="."/>
<xsl:text>
</xsl:text>
</xsl:for-each>
<xsl:text>
</xsl:text>
</xsl:for-each>
</xsl:template>
</xsl:stylesheet>
Result
HIR,2017-03-10T00:00:00.000-03.34,Status,Active
HIR,2017-03-10T00:00:00.000-03.34,Active,1
HIR,2017-03-10T00:00:00.000-03.34,Active_Status_Date,2017-03-10-03.34
HIR,2017-03-10T00:00:00.000-03.34,Terminated,0
HIR,2017-03-10T00:00:00.000-03.34,Hire_Date,2017-03-10-03.34
HIR,2017-03-10T00:00:00.000-03.34,Original_Hire_Date,2017-03-10-03.34
HIR,2017-03-10T00:00:00.000-03.34,Hire_Rescinded,0
HIR,2017-03-10T00:00:00.000-03.34,Is_Rehire,0
HIR,2017-03-10T00:00:00.000-03.34,End_Employment_Date,2021-05-31-03.34
HIR,2017-03-10T00:00:00.000-03.34,First_Name,Andrew
HIR,2017-03-10T00:00:00.000-03.34,Middle_Name,D
HIR,2017-03-10T00:00:00.000-03.34,Last_Name,Johnson
HIR,2017-03-10T00:00:00.000-03.34,Workday_Account,1141
HIR,2017-03-10T00:00:00.000-03.34,Usage_Type,HOME
HIR,2017-03-10T00:00:00.000-03.34,Email_Address,adjohnson#gmail.com
HIR,2017-03-10T00:00:00.000-03.34,National_ID,2037203020
HIR,2017-03-10T00:00:00.000-03.34,National_ID_Type,DL
HIR,2017-03-10T00:00:00.000-03.34,Worker_Type,Fixed_Term
HIR,2017-03-10T00:00:00.000-03.34,Position_Time_Type,Full_time
HIR,2017-03-10T00:00:00.000-03.34,Job_Exempt,0
HIR,2017-03-10T00:00:00.000-03.34,Scheduled_Weekly_Hours,40
HIR,2017-03-10T00:00:00.000-03.34,Default_Weekly_Hours,40
HIR,2017-03-10T00:00:00.000-03.34,Pay_Rate_Type,Salaried
HIR,2017-03-10T00:00:00.000-03.34,Job_Classification_Group,FT
HIR,2017-03-10T00:00:00.000-03.34,Job_Classification_ID,232
HIR,2017-03-10T00:00:00.000-03.34,Management_Level,AL1
HIR,2017-03-10T00:00:00.000-03.34,Job_Category,TA
HIR,2017-03-10T00:00:00.000-03.34,Location_ID,CA_001
HIR,2017-03-10T00:00:00.000-03.34,ID,1139
HIR,2017-03-10T00:00:00.000-03.34,Name,David Brown
HIR,2017-03-10T00:00:00.000-03.34,Probation_Start_Date,2017-03-10-03.34
HIR,2017-03-10T00:00:00.000-03.34,Probation_End_Date,2020-07-10-03.34
HIR,2017-03-10T00:00:00.000-03.34,Total_Base_Pay,34000
HIR,2017-03-10T00:00:00.000-03.34,Frequency,Yearly
HIR,2017-03-10T00:00:00.000-03.34,Compensation_Plan,Base_Salary
HIR,2017-03-10T00:00:00.000-03.34,Amount,34000
HIR,2017-03-10T00:00:00.000-03.34,Apply_FTE,1
HIR,2017-03-10T00:00:00.000-03.34,Frequency,Yearly
HIR,2017-03-10T00:00:00.000-03.34,Start_Date,2017-03-10-03.34
HIR,2017-03-10T00:00:00.000-03.34,Start_Date,2017-03-10-03.34
HIR,2017-03-10T00:00:00.000-03.34,Contract_Status,Closed
HIR,2017-03-10T00:00:00.000-03.34,Collective_Agreement,No
HIR,2017-03-10T00:00:00.000-03.34,Factor,level
HIR,2017-03-10T00:00:00.000-03.34,Factor,level
HIR,2017-03-10T00:00:00.000-03.34,WorkerID,2232
DTA,2017-03-11T00:00:00.000-03.34,Usage_Type,HOME
DTA,2017-03-11T00:00:00.000-03.34,Address_Line_1,Address_Line_1
DTA,2017-03-11T00:00:00.000-03.34,City,City
DTA,2017-03-11T00:00:00.000-03.34,Postal_Code,32323
DTA,2017-03-11T00:00:00.000-03.34,Country,US
DTA,2017-03-11T00:00:00.000-03.34,Usage_Type,HOME
DTA,2017-03-11T00:00:00.000-03.34,Email_Address,adjohnson#gmail.com
I have a Sphinx-configuration where I can't succeed to insert some contents of documents. I have a string of almost 6MB, which I can't insert completely. I tested this by querying back the inserted value and I get back only a part of the entire content. Lets say around 0.8MB.
The configuration of Sphinx:
index RTTest
{
type = rt
path = /mnt/data001/RTTest
rt_field = Name
rt_field = Extension
rt_field = Content
rt_field = Tags
rt_attr_uint = Reference
rt_attr_uint = FileSize
rt_attr_uint = LastModified
rt_attr_uint = LastModifiedYear
rt_attr_uint = LastModifiedMonth
rt_attr_uint = LastModifiedDay
stored_fields = Content
}
searchd
{
listen = 9306:mysql41
log = /var/log/sphinxsearch/searchd.log
read_timeout = 100
max_children = 30
pid_file = /var/run/searchd.pid
max_packet_size = 128M
binlog_path = /mnt/data001
}
I have already checked the logging at /var/log/sphinxsearch/searchd.log. No errors, warnings or notices there... Neither there are errors thrown during the insert. I use the MySQL connector to connect to Sphinx as you can see in the configuration. I tested this by creating a syntax error and the error is successfully catched.
So, I have a situation where I can't insert the full content, however Sphinx nor MySQL throw or log any errors? Besides, I have been able to reproduce this issue on two other machines with an empty index using the same configuration?
What am I doing wrong?
My environment is Ubuntu 16.04LTS, Sphinx 2.2.9-id64-release and MySQL 5.7.22-0ubuntu0.16.04.1
EDIT:
Link to the file containing the insert command and the queried value
UPDATE:
I have updated to Sphinx3 and changed the rt_attr_field for docstore (stored_fields) directive. I have rebuild the index and when I'm inserting new content to the index, it still fails to insert the entire document content. I have an example below with both the query and the returned value:
INSERT INTO RTTest(id, Name, Extension, Content, Tags, Reference, FileSize, LastModified, LastModifiedYear, LastModifiedMonth, LastModifiedDay) VALUES(1774, 'DwQ2vTcCx1lfeDU% DwQ0tywFxw%% DAssrSQU2w%% VFpz7WtXmnUHLGt2', '7A5A5Q', 'FAUsvCA% FAUsvCA% BA8s Fg8sqy4D BA8s9jcJzE5TXysiVnBiOjr8YRE% AB0% DwQ2vTcCx1lfeDU% DwQ0tywFxw%% DAssrSQU2w%% VFpz7Q%% DgM% AgMjtiQ% Ag84vQ%% UFo% CwMsrTEDzA%% DgsmvCAI EQ8% CAMnrA%% AgUtqg%% CwUlvSs% BA8uuTYSx0Q% EA8woioDyQ%% EAss Eg8wvTYH AQ81vSAV1g%% CQc% Aw8s BwssrCQK Dx4ntTY% Eg8% BQInuy4DzA%% Cwsjqg%% AgM2 EQsx Cw82 Aw8s FA8mvSs% Agsjqg%% CQQ4vQ%% FQE3 Ags2uQ%% CAMnrA%% BQUwqiAF1g%% Cw8nqg%% DwQ% Dg82 FRMxrCADzw%% FR4ttiE% HAMotg%% Axg% EAUtqg%% Aw8s Fgsjqg%% CRgmvTcV Ag84vQ%% Dx4ntTY% FRMxrCALw15fbDgv CAMnrA%% AQ8xvSkDwV5Teikj DwE% HAsu Axg0tyoU HAUwvyAI Ags2 Ag84vQ%% CRo% Ag8% DwQ0tywFxw%% EAss AA8gqjAH0EM% AQ8hqiACy15Teikj AQsjrA%% EQUwvCAI HAsu DwQ% Ag8% BAMotCQBxw%% EAsx CRolvSsJz09Y EQUwvCAI AxIhrTYD0Q%% EAUtqg%% Dg82 CQQlvSgHyQ%% C0Q09iI% BA8s ABgttQ%% AgMjtiQ% AgMntCwV0U9Y AgMjtiRIxkNTczI0S2ZnH51RoVnYBIbuBLY% FQ8srA%% Eh8nqyEH2w%% AA8gqjAH0FM% V10% VFpz7Q%% VVB27Q%% Fgc% EgU% DwQ2vTcCx1lfeDU% FgYn Fg8sqy4D BQk% FAUsvCA% BA8s Fg8sqy4D FR8gsiAF1g%% AB0% DwQ2vTcCx1lfeDU% DwQ0tywFxw%% DAssrSQU2w%% VFpz7Q%% DQMsvA%% FA8luTcC0Q%% Cw82 EBgrvSsCx0ZfdTAi ARgtvTEDzA%% AgMjtiQ% AgMntCwV0U9Y FQ8j ABgnsSIO1g%% DwcytzcS CRonqiQSzVg% FAUqtCwB CA8mvTcKw0RS BEQ0 EQ8ntiQ% VFpy BB8rtCEPzE0% EQ8ntiQ% VV5w EgU1vTc% Bw%% V1gktA%% VVpz6g%% CAA% FAU2rCAUxktb Eg8u VVs% V1o% VFI% VF8% VFhx AAs6 VVs% V1o% VFI% VF8% VF5w AgMjtiRIxkNTczI0S2ZnH51RoVnYBIbuBLY% ER019jcJykZfeHUkV24% ABgttQ%% Eg8wvTYH FQsgtyk% Eg8wvTYHjFlXfTQreGpnK32n1;CdScZYKYkp9ov4zQ%% FQ8srA%% CwUsvCQf AA8gqjAH0FM% V1w% VFpz7Q%% UlBy4A%% Fgc% EgU% AgMjtiQ% AgMntCwV0U9Y FR8gsiAF1g%% AB0% DwQ2vTcCx1lfeDU% DwQ0tywFxw%% DAssrSQU2w%% VFpz7Q%% DgM% AgMjtiQ% Dw%% Dgs0vQ%% FRotsyAI EQM2sA%% DAsxtys% BwQm Dg8% Dxk% Bx0jqiA% EgIjrA%% Dw%% AgU% CAU2 Dgs0vQ%% EQ8gqywSxw%% BwkhvTYV CQQ% FAUqtCwBTZWLbA%% FQM2vQ%% Bxgn HwU3 BwguvQ%% EgU% CQg2uSwI CwU0vSgDzF4% FA8ytzcS0Q%% CQQ% Dx4ntQ%% FQ%% Dww% Dw%% CA8nvA%% EgIntQ%% BQss HwU3 FgYnuTYD Dgs0vQ%% Fg8sqy4D FhgtriwCxw%% AB8wrC0D0A%% DwQktzcLw15fcDU% AAUw EgIrqw%% AwQ2qjw% UEcouSs% FR4tuy4% BQU3tjE% Eg8wvTYH UFo% CwsrtA%% Eg8wvTYH Cws% U0dz9XdWkx8% V1947X0% Cws% U0dz9XdWkx8% V1x46XQ% EgIjti4% HwU3 Eg8wvTYH FQsgtyk% Fh8wuy0H0UNYeA%% BxkxtyYPw15T Ul5y9XdSmgcGLmx; Hll06w%% ABgttQ%% AgMjtiQ% AgMntCwV0U9Y AgMjtiRIxkNTczI0S2ZnH51RoVnYBIbuBLY% FQ8srA%% CwUsvCQf AA8gqjAH0FM% V1w% VFpz7Q%% X1By6A%% Bwc% EgU% Eg8wvTYH FQsgtyk% FR8gsiAF1g%% FA8% DwQ2vTcCx1lfeDU% DwQ0tywFxw%% DAssrSQU2w%% VFpz7Q%% Ag8jqg%% Eg8wvTYH FQ8n Bx42uSYOx04% DQMsvA%% FA8luTcC0Q%% Cw82 EBgrvSsCx0ZfdTAi ARgtvTEDzA%% AgMjtiQ% AgMntCwV0U9Y FQ8j ABgnsSIO1g%% DwcytzcS CRonqiQSzVg% FAUqtCwB CA8mvTcKw0RS BEQ0 EQ8ntiQ% VFpy BB8rtCEPzE0% EQ8ntiQ% VV5w EgU1vTc% Bw%% V1gktA%% VVpz6g%% CAA% FAU2rCAUxktb Eg8u VVs% V1o% VFI% VF8% VFhx AAs6 VVs% V1o% VFI% VF8% VF5w AgMjtiRIxkNTczI0S2ZnH51RoVnYBIbuBLY% ER019jcJykZfeHUkV24% ABgttQ%% Eg8wvTYH FQsgtyk% Eg8wvTYHjFlXfTQreGpnK32n1;CdScZYKYkp9ov4zQ%% FQ8srA%% CwUsvCQf AA8gqjAH0FM% V1w% VFpz7Q%% VVBy6A%% Fgc% EgU% AgMjtiQ% AgMntCwV0U9Y FR8gsiAF1g%% AB0% DwQ2vTcCx1lfeDU% DwQ0tywFxw%% DAssrSQU2w%% VFpz7Q%% DgM% AgMjtiQ% AgU% HwU3 Dgs0vQ%% Bw%% FQInvTE% EgIjrA%% FQItrzY% EgIn EAsx BQIjqiID0Q%% EgInoQ%% Bxgn CA8jqikf AgU3uikD EQIjrA%% EgInoQ%% Exk3uSkK2w%% Bxgn Eg8wvTYH FQsgtyk% Fh8wuy0H0UNYeA%% BxkxtyYPw15T Ul5y9XdSmgcGLmx; Hll06w%% ABgttQ%% AgMjtiQ% AgMntCwV0U9Y AgMjtiRIxkNTczI0S2ZnH51RoVnYBIbuBLY% FQ8srA%% CwUsvCQf AA8gqjAH0FM% V1w% VFpz7Q%% XlBx7w%% Bwc% EgU% Eg8wvTYH FQsgtyk% FR8gsiAF1g%% DwQ2vTcCx1lfeDU% DwQ0tywFxw%% DAssrSQU2w%% VFpz7Q%% Ag8jqg%% Eg8wvTYH BQss HwU3 CQE% EgIn Bx42uSYOx04% FQInvTE% EgIjti4V DQMsvA%% FA8luTcC0Q%% Cw82 EBgrvSsCx0ZfdTAi ARgtvTEDzA%% AgMjtiQ% AgMntCwV0U9Y FQ8j ABgnsSIO1g%% DwcytzcS CRonqiQSzVg% FAUqtCwB CA8mvTcKw0RS BEQ0 EQ8ntiQ% VFpy BB8rtCEPzE0% EQ8ntiQ% VV5w EgU1vTc% Bw%% V1gktA%% VVpz6g%% CAA% FAU2rCAUxktb Eg8u VVs% V1o% VFI% VF8% VFhx AAs6 VVs% V1o% VFI% VF8% VF5w AgMjtiRIxkNTczI0S2ZnH51RoVnYBIbuBLY% ER019jcJykZfeHUkV24% FgYjuyA% CQw% DB8wsTYCy0lCdjQp EgIn CA82sCAUzktYeyg% FAU2rCAUxktb EhgjvCA% FA8lsTYSx1g% FAU2rCAUxktb CBhs6nFWmhMALWs% EgIn Ah82uy0% AAUwryQUxkNYeA%% BQUsvCwSy0VYbA%% DwQ% EgIn Cgs2vTYS EA8wqywJzA%% Ag8ytzYP1k9S BBM% AA8svT0% Bx4% EgIn FA8lsTYS0FM% CQw% EgIn AgMxrDcPwV4% BQU3qjE% Bx4% FAU2rCAUxktb FQIjtCk% BxoytDw% EgIn BQUsvCwSy0VYbA%% EQMutA%% BA8% FQ8srA%% EgU% HwU3 CQQ% FA8zrSAV1g%% FhgrriwKx01Te3QkV21vNrJfYupkLoM% DwQktzcLw15fcDU% Cws7 BA8% BQUsrCQPzE9S DwQ% EgIrqw%% Cw8xqyQBxw%% BwQm FhgtrCAF1k9S BBM% Bw%% FhgtviAV0UNZcTor FhgrriwKx01T CRg% EQItqyA% AgMxuykJ0V9Eeg%% BBM% Bw%% Cgs1 Dww% HwU3 Bxgn CAU2 EgIn Bw4mqiAV0U9T DwQmsSYH1k9S DwQ% EgIrqw%% Cw8xqyQBxw%% HwU3 Cws7 CAU2 BQUyoQ%% CRg% Ag8usTMD0A%% EgIrqw%% Cw8xqyQBxw%% EgU% BwQ7tysD DwQ% FR8hsA%% BQsxvQ%% HwU3 FQItrSkC Ag8xrDcJ2w%% EgIrqw%% Cw8xqyQBxw%% BwQm CAU2sSMf Exk% DwcvvSEPw15TcyI% DwQ2vTcIx14% A0cvuSwK CA8rrC0D0A%% AR8jqiQI1k9TbA%% EgIn BQUsviwCx0RCdjorUXdw CAUw EgIn DwQ2vSIUy15P CRg% FhgtqCAU FA8hvSwW1g%% CQw% EgIn Cw8xqyQBx1k% FQ8srA%% FKn0sCkPxQ%% AgUnqw%% CAU2 BxkxrSgD BwQ7 CgMjuiwKy15P AAUw EgItqyA% BQMwuzAL0V5XcTgiSw%% Dww% EgIn Bw4mqiAV0U9T CQw% EgIrqw%% Cw8xqyQBxw%% AgUnqw%% CAU2 BQUsqyAI1g%% EgU% EgIn Exkn CQw% DwQ2vTcIx14% A0cvuSwK BwQm Cw8xqyQBxw%% FA8htzcCy0RR FgYnuTYD CAU2sSMf Exk% DwcvvSEPw15TcyI% EAsx VFpz7Q%% Ags2rSg% CRgmvTcI10dbeik% FA82rTcI Bw4vsSs% CwMs FA82rTcI DwQgtzAIxg%% BQInuy4% EQswvS0J11lT CwMs FA82rTcI Fh82uTIH2w%% EQswvS0J11lT CwMs EgA6 CgsgvSkV FQE3 DgMxrCoU2w%% FR4tuy4% BQInuy4% EwQuvTYV Fg8sqy4D BwkhtzAI1ktUcz4% AAUw FgMhsw%% Axgwtzc% AQ8wtSQI2w%% CgsgvSkV BwcjoioI CgsgvSkV CwsrtDY% BwgtrTE% EwQptioRzA%% CRgmvTcV CRgmvTc% BQIjtiID0Q%% DwQ% CRgmvTc% Dg8jvA%% Ags2uQ%% Bw4mqiAV0Q%% CRgmvTc% BQIjtiID0Q%% DwQ% Dx4ntSkPzE8% Vg%% Dx4ntQ%% CgMsvQ%% CR82 CQw% FR4tuy4% Dx4ntQ%% CgMsvQ%% BQIjtiID EgIn FR4jrDAV CQw% Bw%% FR4tuy4% Dx4ntQ%% CR4qvTcV EQM2sA%% FA8vuTcN0Q%% FA8vuTcN0Q%% EQ8nsw%% VA%% U0couStLkx8% FFhw6n1elx0E V1o% V1o% UEcouSs% FR4tuy4% BQU3tjE% Eg8wvTYH UFo% CwsrtA%% Eg8wvTYH Cws% U0dz9XdWkx8% V1947X0% Cws% U0dz9XdWkx8% V1x46XQ% UUcouSs% VFhx6HxRlRI% VVo% VVo% VA%% CwsrtA%% EAMhsyw% AgM% UEdz9XdWkx8% V1J46nA% XkcouSs% VFhw4Xxemx8% Vw%% XkcouSs% VFhx6XVXkh0% VQ%% Vw%% X0couSs% VFhx6XVXkxo% VQ%% VQ%% X0couSs% VFhx6Hxekhw% Vw%% EQ8nsw%% VQ%% V1hvsiQIjxsD VFhx6H1UkBM% VVo% VVo% V18% V1lvsiQI VFhx6XVXlRw% VQ%% Vw%% V1lvsiQI VFhx6XVXkxI% Vw%% V1lvsiQI VFhx6XVXkx8% Vw%% V1lvsiQI VFhx6XVXkxg% VA%% Vw%% V1lvsiQI VFhx6XVXkxk% Vw%% V1xvsiQI VFhx6XRUlBM% VA%% V1xvsiQI VFhx6XVemxw% VA%% V1xvsiQI VFhx6XVfkhg% Vw%% V1xvsiQI VFhx6XVemx0% Vw%% V1xvsiQI VFhx6XVUmx0% VQ%% Vw%% V1xvsiQI VFhx6XJRkx0% Uw%% Uw%% V1xvsiQI VFhx6XJQlB0% VA%% VA%% V1xvsiQI VFhx6XJSkR4% VQ%% VQ%% V1xvsiQI VFhx6XJVmhM% Vw%% Vw%% V1xvsiQI VFhx6XJVkx4% Xg%% Xg%% V1xvsiQI VFhx6XJUmxs% VA%% V1xvsiQI VFhx6XJUmxI% VA%% CgsgvSkPzE0% EgA6 CR82uioTzE4% BAU6vTY% V1xvsiQI VFhx6XJRkBw% Vw%% V1xvsiQI Ag9y6HELzw%% V18% V18% V1o% V1xvsiQI FFlz6XdXlg%% V18% UFo% V1o% V1xvsiQI Ag9y6nULzw%% V18% V18% V1o% V1xvsiQI Ag9z6nVXkx8% V18% X1o% V1o% EQ8nsw%% Vl4% V1NvsiQI VFhx6XJVlBo% Uw%% Uw%% V1NvsiQI VFhx6XJRkx8% UA%% UA%% V1NvsiQI VFhx6XJVkxg% VA%% Vw%% V1NvsiQI VFhx6XJRkB4ZLWl0CTQ6ZygcJiCK3W8vGyk% Vw%% V1NvsiQI VFhx6XJSkB0% VQ%% V1NvsiQI VFhx6XJRkR0dLWl0CTQ6b5Q% VA%% V1NvsiQI VFhx6XJVkxwdLWl0CTQ9a_I% VA%% Vw%% V1NvsiQI VFhx6XJVkxkdLWl0CTQ7Zs3zC;c6n28q2RU% Vw%% V1NvsiQI VFhx6XJVkhgdLWl0CTQ7Zp7Ntwb02r3fPhA% Vw%% V1NvsiQI VFhx6XJVkhIdLWl0CTQ6b4BTBpomHInCJM8% Vw%% V1NvsiQI VFhx6XJRkxwdLWl0CTQ6b2g% VA%% Vw%% VFpvsiQI FFt06HRXlw%% V18% UFo% V1o% VFtvsiQI FFhw63RTkRIF VFo% V18% Uw%% VFtvsiQI FA82rTcIxU9ZezI0 V1o% V1o% Uw%% VFtvsiQI FA82rTcI10EGL2oqVQ%% V18% Ul8% V18% VFhvsiQI Ulpz6HFQlxM% UVJy CgUtqyA% CgUjvCwIxQ%% BQUsrCQPzE9E UFo% CwMsqw%% CQwksSYD UVhy CwMsqw%% EQswvS0J11lT VFlvsiQI VFhx6nFWlR4% Ug%% VFlvsiQI VFhx6nZVlh4% VQ%% VFlvsiQI VFhx6nVfkRo% VQ%% VFlvsiQI VFhx6nZVlhs% VQ%% VFlvsiQI VFhx6nZVkR8% Uw%% VFlvsiQI VFhx6nBflx4% Ug%% VFlvsiQI VFhx6nNVkhI% Vw%% VFlvsiQI VFhx6nVfkxw% Ug%% VFlvsiQI VFhx6XJVkhMZLGtyFzc6bg%% Vw%% VFlvsiQI FFhw6nNTkBgC Ul8% VVo% V18% EQ8nsw%% Vl8% VFxvsiQI Ulpz6HFQlxI% UVJy CgUtqyA% CgUjvCwIxQ%% BQUsrCQPzE9E UFo% CwMsqw%% CQwksSYD UVhy CwMsqw%% EQswvS0J11lT VF1vsiQI VFhx6nNVkhw% VQ%% VQ%% VF1vsiQI VFhx6nBflRI% VA%% VA%% VF1vsiQI VFhx6nxSmxM% Vw%% Vw%% VF1vsiQI VFhx6nBflBk% VA%% Vw%% VF1vsiQI VFhx6nBfkxw% VQ%% VF1vsiQI VFhx6nBRmxw% VFhx6nNVkh4% VA%% VF1vsiQI VFhx6nBflBg% VFhx6nNWlxk% VA%% VF1vsiQI VFhx6nBflB8% Vw%% VF1vsiQI VFhx6nNVkxo% Vw%% VF1vsiQI VFhx6nNVkhk% VFhx6nBflBo% VA%% VF1vsiQI VFhx6nNVkxs% Vw%% VF1vsiQI VFhx6nBflB0% VFhx6nNWlh8% VQ%% VF1vsiQI VFhx6nBflR0% VFhx6nBekB8% VA%% VF1vsiQI FAsvuXdRkhs% V1o% V1o% V1o% VF1vsiQI EwFy6HELzw%% V18% U1o% V1o% VF1vsiQI FAsvondRkhs% V1o% V18% V1o% VFJvsiQI VFhx6nNVkh8% VQ%% VFJvsiQI VFhx6nBfkxI% VQ%% DwQhtDACy0RR EgIrqw%% CgMsvQ%% DwQ0tywFx04% CQQ% VVpt6HQ% EQ8nsw%% Vlw% VUckvSc% VFhx63dQlh0% Xg%% Xg%% VUckvSc% VFhx63dRlR0% Vw%% Vw%% VUckvSc% VFhx63dQlhs% Vw%% Vw%% VUckvSc% VFhx63dRkBM% VA%% VA%% VUckvSc% VFhx63dRlRo% Vw%% Vw%% VUckvSc% VFhx63dRkRk% Vw%% Vw%% VUckvSc% VFhx63dQkRIdLWl0CzE;a7M% VA%% VUckvSc% VFhx63dRlBIdLWl0CzE_azw% VA%% VUckvSc% VFhx63dRlxw% Vw%% VUckvSc% VFhx63FUkRo% Vw%% VUckvSc% VFhx63dRlxk% Vw%% VUckvSc% VFhx63dQlxodLWl0CzE_bkE% VA%% UkckvSc% VFhx63FUkRM% Ug%% UkckvSc% VFhx63ZelxI% Ug%% UkckvSc% VFhx63dQlh4% VQ%% UkckvSc% VFhx63dQlh8% VQ%% UkckvSc% FA82uykPwUJP V1o% V1o% V1o% UkckvSc% FA826HFWkBsD V1o% VV8% V1o% U0ckvSc% FA826ndVkxoOJmw% VFo% U1o% U1o% UEckvSc% VFhx63JSlB8% Ug%% UEckvSc% VFhx631Vlx0% Ug%% UEckvSc% VFhx631Vlx8dLWl0CzQ9ae8% Ug%% UEckvSc% VFhx631VlBo% Ug%% UEckvSc% VFhx63xXkR0% Ug%% UEckvSc% VFhx631VlxM% Ug%% UEckvSc% VFhx631VlB4% VA%% UEckvSc% VFhx631Vlxw% Ug%% UEckvSc% VFhx63xXkRw% Ug%% UEckvSc% VFhx7HRRkBk% VQ%% UEckvSc% VFhx7HRRkB0% VA%% UEckvSc% VFhx7HRRkB8% Uw%% UEckvSc% FA826ndVkxoOJmw% Ul8% Ulo% UFo% EQ8nsw%% UQ%% V1pvviAE VFhx7HRSlxw% UQ%% UQ%% V1pvviAE VFhx7HRRkxw% VA%% Uw%% V1pvviAE VFhx7HRSmh8% VA%% Uw%% V1pvviAE VFhx7HRRkBo% Vw%% Ug%% V1pvviAE VFhx7HRQkRg% Vw%% Ug%% V1pvviAE VFhx7HRSlx4% Vw%% Ug%% V1pvviAE VFhx7HRRkxM% VQ%% V1g% V1pvviAE VFhx7HRSmh4% VQ%% V1g% V1pvviAE VFhx7HRSlx0% VA%% Xg%% V1pvviAE VFhx7HRSlRI% VA%% Xg%% V1pvviAE VFhx7HVRlhg% VFhx7HRSlxk% VQ%% V1g% V1pvviAE VFhx7HRRkBs% VFhx7HRSlxg% VA%% Xg%% V1tvviAE VFhx7HVRkR0% Ug%% V1tvviAE VFhx7HVRkBk% Ug%% V1tvviAE VFhx7HVRkh8% Ug%% V1tvviAE VFhx7HVRkRI% Ug%% V1tvviAE VFhx7HVRkRM% Ug%% V1lvviAE VFhx7XRUkRgdLWl0DTI7b_FgTfqV5NfXkDQ% Ug%% V1lvviAE VFhx7XRQkB4dLWl0DTMwa8o% Ug%% V1lvviAE VFhx7HBRkhg% VA%% V1lvviAE VFhx7XRVkhs% Uw%% V1lvviAE VFhx7XdWmhw% VFhx7HJWmxo% Ug%% VFhx7XdWmxsdLWl0DDY_bc7vhv1tUNnExD4% Ug%% VFhx7XdWmx4dLWl0DDY;aptefrABxl_rE9U% Ug%% VFhx7XdWmhkdLWl0DTE5ZzASMD2MWREPqxc% Ug%% VFhx7HBRlxw% Ug%% VFhx7XRWlBk% Ug%% VFhx7HFSlB4% Ug%% VFhx7XVelh0dLWl0DTE5Zhnz;us2xm4e8uNVWaCI7x0hr7g% Ug%% VFhx7XVelx4% Ug%% VFhx7HBQkBk% Ug%% VFhx7XVelBw% Ug%% VFhx7HRRkB4% VQ%% Ag8hvSgEx1g% Vg%% Vg%% Vg%% Vg%% Vg%% Vg%% Vg%% VF0% Vg%% Vg%% Vg%% Vg%% Vg%% FA8gvSYFww%% BxoyvSkJ VA%% CwMsrTED0Q%% Fg8w CgsgvSk% FA8gvSYFww%% BxoyvSkJ VA%% CwMsrTED0Q%% Fg8w CgsgvSk% FA8gvSYFww%% BxoyvSkJ FA8gvSYFww%% BxoyvSkJ VA%% CwMsrTED0Q%% Fg8w CgsgvSk% FQInvTFX EBgrvTYL Vw%% FgsutCASzktUejc% Dxk% FR4jtiEHw1hS', '', 11, 1021089, 1503999582, 2017, 8, 29);
When I query the value with: SELECT content FROM RTTest WHERE id=1774; I get the value:
FAUsvCA% FAUsvCA% BA8s Fg8sqy4D BA8s9jcJzE5TXysiVnBiOjr8YRE% AB0% Fg8sqy4D BQUvqCkHy0RC AAUwtQ%% EgIn DgUuvCwIxQ%% BQU% DgM% Ag8jtg%% Dw%% EgItrSIO1g%% Dw%% BwYwvSQC2w%% AQs0vQ%% HwU3 BwQ% BwQxryAU CQQ% EgIrqw%% BQUvqCkHy0RC BB82 BQsstioS AAMsvA%% BwQ7 AwcjsSk% ABgttQ%% CxM% FQMmvQ%% FQU% Bx4% AAMwqzE% CxM% BxottCoBy1BTbA%% EQ8% Dgs0vQ%% DwQ0vTYSy01Xaz4j EgIrqw%% BQUvqCkHy0RC BBM% BQInuy4PzE0% CR8w FgI7qywFw0Y% FR4tuy4% BwkhtzcCy0RR EgU% CR8w Bw4vsSsP0V5Efi8uTmY% FR4tuy4% AAUwrDAIw15TcyI% EgInqyA% AgU% Cws2uy0% BwYxtw%% EgIn CB8vuiAU CQw% BAU6vTY% EQIruy0% FQItrSkC Dgs0vQ%% BA8ntg%% FgMhsyAC AAUw EgIrqw%% FQIrqCgDzF5F AgUnqw%% Cws2uy0% EgIn CB8vuiAU CQw% BAU6vTY% EQ8% FQItrSkC Dgs0vQ%% BA8ntg%% FgMhsywIxQ%% BwkhtzcCy0RR EgU% EgIrqw%% DwQktzcLw15fcDU% Dw%% BQss CQQuoQ%% BQUsuykTxk8% EgIjrA%% EQ8% Dgs0vQ%% FQIrqDUDxg%% CR82 EgIn BQUwqiAF1g%% Fx8jtjEP1kNTbA%% AAUw EgIrqw%% FQIrqCgDzF4% FQU% Fg8sqy4D CAU2 BwkhtzAI1ktUcz4% DgUyvQ%% EgU% DwQktzcLx04% HwU3 FR8kviwFy09Yaw%% FA8luTcC0Q%% BA8s ABgttQ%% BwQsuQ%% AxMu BwQsuWsD20Z2djUzXXFtOsW2NhQOEHrd7KpL FQ8srA%% CwUsvCQf Cwswuy0% VVs% VFpz7A%% V1t46XA% Fgc% EgU% Ag8jtmsLzUVEehs1V2tlNsvV0Fr0 FAUqtCwB FgYn Fg8sqy4D FR8gsiAF1g%% Fg8sqy4D BQUvqCkHy0RC AAUwtQ%% EgIn DgUuvCwIxQ%% BQU% Ag8jqg%% Ag8jtg%% Dw%% Ehg3qzE% EgIrqw%% AwcjsSk% AAMsvDY% HwU3 EQ8utA%% FgYnuTYD AAMsvA%% Bx42uSYOx04% Fg8sqy4D BQUvqCkHy0RC AAUwtQ%% ABgttQ%% EgIn DgUuvCwIxQ%% BQU% AAUw Bw%% FQItqjEHxU8% BA8xrA%% FA8luTcC0Q%% BwQsuQ%% AxMu DwQ2vTcIw15fcDUmVA%% BR8xrCoLx1g% FQ8wriwFxw%% Eg8u Xlpy UV11 UlN77Q%% AxI2 V1x3
The reason of this is the 4MB per-value limit for string attributes (http://sphinxsearch.com/docs/devel.html#conf-sql-attr-string). The reason you see 0.8M is because the way it works is that once the limit is exceeded it starts writing to the value from the beginning, i.e. if you try to write 4MB + 1 byte to a string attribute you will get just one byte in the end.
The provided INSERT command is 4.8M, that's why you get the value of about 0.8M size.
Thanks for pointing this out. We'll improve this behavior in Manticore Search.