Open .dly file (GHCN / NOAA data) for analysisWindows 7, Python script to use command to access megawarc web...
word describing multiple paths to the same abstract outcome
How can I raise concerns with a new DM about XP splitting?
Is the next prime number always the next number divisible by the current prime number, except for any numbers previously divisible by primes?
Can I use my Chinese passport to enter China after I acquired another citizenship?
The One-Electron Universe postulate is true - what simple change can I make to change the whole universe?
I'm in charge of equipment buying but no one's ever happy with what I choose. How to fix this?
My boss asked me to take a one-day class, then signs it up as a day off
Why is delta-v is the most useful quantity for planning space travel?
What (else) happened July 1st 1858 in London?
Can I Retrieve Email Addresses from BCC?
What if somebody invests in my application?
Is there a good way to store credentials outside of a password manager?
Calculating the number of days between 2 dates in Excel
Why does this part of the Space Shuttle launch pad seem to be floating in air?
Why are on-board computers allowed to change controls without notifying the pilots?
How to interpret the phrase "t’en a fait voir à toi"?
How will losing mobility of one hand affect my career as a programmer?
node command while defining a coordinate in TikZ
Installing PowerShell on 32-bit Kali OS fails
Perfect riffle shuffles
The most efficient algorithm to find all possible integer pairs which sum to a given integer
Who must act to prevent Brexit on March 29th?
Hostile work environment after whistle-blowing on coworker and our boss. What do I do?
Could solar power be utilized and substitute coal in the 19th century?
Open .dly file (GHCN / NOAA data) for analysis
Windows 7, Python script to use command to access megawarc web archive file,Why Does Clicking on Applescript Notifications Open the AppleScript Editor?Change icon of fileHow can I automatically open files in an editor in WindowsHow Are Integers Stored In ExcelRun custom command instead of browser when clicking http(s) linksDatabase interaction for technical and non-technical peopleRemove Lines that Match from FileExclude a program from the Open With list for a specific file extensionAggregate Analysis of a CSV file
I am trying to work with the data available from: https://www.ncdc.noaa.gov/cdo-web/datasets and https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/hcn/
It comes in a .dly file. Is there a way to open this with Python or Excel?
My ultimate goal is to have them in a file format that I can open with Python and Pandas.
python file-types
add a comment |
I am trying to work with the data available from: https://www.ncdc.noaa.gov/cdo-web/datasets and https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/hcn/
It comes in a .dly file. Is there a way to open this with Python or Excel?
My ultimate goal is to have them in a file format that I can open with Python and Pandas.
python file-types
add a comment |
I am trying to work with the data available from: https://www.ncdc.noaa.gov/cdo-web/datasets and https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/hcn/
It comes in a .dly file. Is there a way to open this with Python or Excel?
My ultimate goal is to have them in a file format that I can open with Python and Pandas.
python file-types
I am trying to work with the data available from: https://www.ncdc.noaa.gov/cdo-web/datasets and https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/hcn/
It comes in a .dly file. Is there a way to open this with Python or Excel?
My ultimate goal is to have them in a file format that I can open with Python and Pandas.
python file-types
python file-types
asked Mar 14 '18 at 21:46
BruceWayneBruceWayne
2,0121721
2,0121721
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
These are fixed-width format files - each column is a specific number of characters wide. You can read it with pandas.read_fwf()
.
There is a readme.txt
available at https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/ for the GHCN data you linked, which includes a title, width and data type for each column. You can supply these to read_fwf()
if the automatic width detection doesn't work. I think you have to add the column titles manually though.
edit: I have added an example snippet you can use at https://gitlab.com/snippets/1838910
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "3"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1303531%2fopen-dly-file-ghcn-noaa-data-for-analysis%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
These are fixed-width format files - each column is a specific number of characters wide. You can read it with pandas.read_fwf()
.
There is a readme.txt
available at https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/ for the GHCN data you linked, which includes a title, width and data type for each column. You can supply these to read_fwf()
if the automatic width detection doesn't work. I think you have to add the column titles manually though.
edit: I have added an example snippet you can use at https://gitlab.com/snippets/1838910
add a comment |
These are fixed-width format files - each column is a specific number of characters wide. You can read it with pandas.read_fwf()
.
There is a readme.txt
available at https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/ for the GHCN data you linked, which includes a title, width and data type for each column. You can supply these to read_fwf()
if the automatic width detection doesn't work. I think you have to add the column titles manually though.
edit: I have added an example snippet you can use at https://gitlab.com/snippets/1838910
add a comment |
These are fixed-width format files - each column is a specific number of characters wide. You can read it with pandas.read_fwf()
.
There is a readme.txt
available at https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/ for the GHCN data you linked, which includes a title, width and data type for each column. You can supply these to read_fwf()
if the automatic width detection doesn't work. I think you have to add the column titles manually though.
edit: I have added an example snippet you can use at https://gitlab.com/snippets/1838910
These are fixed-width format files - each column is a specific number of characters wide. You can read it with pandas.read_fwf()
.
There is a readme.txt
available at https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/ for the GHCN data you linked, which includes a title, width and data type for each column. You can supply these to read_fwf()
if the automatic width detection doesn't work. I think you have to add the column titles manually though.
edit: I have added an example snippet you can use at https://gitlab.com/snippets/1838910
edited 2 mins ago
answered Feb 14 at 1:24
naught101naught101
606821
606821
add a comment |
add a comment |
Thanks for contributing an answer to Super User!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1303531%2fopen-dly-file-ghcn-noaa-data-for-analysis%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown