You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to use class deserialization to read from a parquet file with columns defined as below. The column names have dot delimiters to represent my C# class hierarchy, which I've had success with in other situations.
Column names:
timestamp, electricity.cooling.energy_consumption_intensity, electricity.fans.energy_consumption_intensity, district_cooling.cooling.energy_consumption_intensity, etc.
My root C# class looks like this:
public class TimeSeriesResult
{
public DateTime timestamp { get; set; }
public DistrictCooling district_cooling { get; set; }
public DistrictHeating district_heating { get; set; }
public Electricity electricity { get; set; }
public NaturalGas natural_gas { get; set; }
public OtherFuel other_fuel { get; set; }
public SiteEnergy site_energy { get; set; }
}
All the property names throughout the nested class structure exactly match the parquet column names, yet when I call ParquetSerializer.DeserializeAsync<TimeSeriesResult>(), only the timestamp comes back with a value, and everything else comes back null
Any ideas for how to get the rest of the data to deserialize properly?
Do I maybe need to modify my schema to account for the struct fields when creating the parquet files?
For additional context: I'm creating the parquet files myself, and have full ownership of the C# code, so I can make changes on either side of things, but I'm out of ideas and could use some help.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'm trying to use class deserialization to read from a parquet file with columns defined as below. The column names have dot delimiters to represent my C# class hierarchy, which I've had success with in other situations.
Column names:
My root C# class looks like this:
All the property names throughout the nested class structure exactly match the parquet column names, yet when I call
ParquetSerializer.DeserializeAsync<TimeSeriesResult>()
, only the timestamp comes back with a value, and everything else comes back nullAny ideas for how to get the rest of the data to deserialize properly?
Do I maybe need to modify my schema to account for the struct fields when creating the parquet files?
For additional context: I'm creating the parquet files myself, and have full ownership of the C# code, so I can make changes on either side of things, but I'm out of ideas and could use some help.
Beta Was this translation helpful? Give feedback.
All reactions