elective-stereophonic
elective-stereophonic
NXTorrent singapore
Please login or register.

Login with username, password and session length
Advanced search  

News:

Latest Stable Nxt Client: Nxt 1.12.2

Pages: 1 [2] 3 4 ... 9  All

Author Topic: NXTorrent  (Read 29340 times)

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #20 on: April 14, 2014, 03:05:15 pm »

Found a unix solution! Aria2 http://linuxconfig.org/aria2-all-in-one-command-line-download-tool
It seems perfect. So just need to port this to Mac and if a Cygwin requirement for windows is acceptable, I think we could get this cross platform.

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #21 on: April 14, 2014, 03:50:37 pm »


When you first run it, it will take a while generating a high entropy password. It will print this and the NXT address. You need to send it some testnxt so that it will be able to send AM's

All the API commands are via 127.0.0.1:7777 that brings up the webpage that is bundled, but you need to first tell the API where to get that file using:
http://127.0.0.1:7777/NXTorrent?{%22requestType%22:%22changeurl%22,%22URL%22:%22/Users/jl777/Documents/NXTprotocol.html%22}

Then you can use the form, but that hasnt been debugged yet, so for now 127.0.0.1:7777/NXTorrent?{JSON} is the way to test. The following is the supported grammar:

    static char *changeurl[] = { (char *)changeurl_func, "changeurl", "", "URL", 0 };
    static char *listings[] = { (char *)listings_func, "listings", "", "NXT", "filters", 0 };
    static char *list[] = { (char *)list_func, "list", "", "NXT", "listing", 0 };
    static char *status[] = { (char *)status_func, "status", "", "NXT", "listingid", 0 };
    static char *cancel[] = { (char *)cancel_func, "cancel", "", "NXT", "listingid", 0 };
    static char *makeoffer[] = { (char *)makeoffer_func, "makeoffer", "", "NXT", "listingid", "bid", 0 };
    static char *acceptoffer[] = { (char *)acceptoffer_func, "acceptoffer", "", "NXT", "listingid", "buyer", 0 };
    static char *feedback[] = { (char *)feedback_func, "feedback", "", "NXT", "listingid", "rating", "aboutbuyer", "aboutseller", 0 };
 
The second entry is the requestType, the third entry is whether signed token is required, third is usually NXT account of the sender,the rest are command specific. When signed tokens are required, the syntax changes to:
[{JSON},{"token":"<nxt token using {JSON} as the website"}]

Hope this all makes sense

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #22 on: April 14, 2014, 03:54:59 pm »

i get this error

Quote
websocket connection CLOSED
Logged

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #23 on: April 14, 2014, 04:02:56 pm »

i get this error

Quote
websocket connection CLOSED
When you first run it, it could take minutes for it to generate the high entropy bits
Do the API commands work?
what is the terminal window displaying?
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #24 on: April 14, 2014, 04:26:05 pm »

i get this error

Quote
websocket connection CLOSED
When you first run it, it could take minutes for it to generate the high entropy bits
Do the API commands work?
what is the terminal window displaying?

oh im using windows. you wrote this for linux i take it?
Logged

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #25 on: April 14, 2014, 04:38:29 pm »

http://en.wikipedia.org/wiki/BitTorrent_tracker

this is a point of weakness for torrents. do you think that we could use the redundancy of the blockchain to address this critical point? perhaps the client could abstract tracking information from the blockchain and loopback to find a locally stored tracker that is derived from information in the blockchain.
Logged

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #26 on: April 14, 2014, 04:46:39 pm »

http://en.wikipedia.org/wiki/BitTorrent_tracker

this is a point of weakness for torrents. do you think that we could use the redundancy of the blockchain to address this critical point? perhaps the client could abstract tracking information from the blockchain and loopback to find a locally stored tracker that is derived from information in the blockchain.
Its only for Mac for now
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #27 on: April 14, 2014, 04:58:20 pm »

http://en.wikipedia.org/wiki/BitTorrent_tracker

this is a point of weakness for torrents. do you think that we could use the redundancy of the blockchain to address this critical point? perhaps the client could abstract tracking information from the blockchain and loopback to find a locally stored tracker that is derived from information in the blockchain.
Well, sure, but if you were worried about blockchain bloat from the AM's from NXTorrent fields, you will not like that each tracker would need to generate a periodic AM (if it even fits in one), otherwise it will become useless over time. How long a tracker's data is valid for, I have no idea.

If this was a separate project, I am sure I can come up with some sort of practical way of maximizing practical value of tracker data delivered vs. blockchain space used.

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #28 on: April 14, 2014, 05:22:51 pm »

http://en.wikipedia.org/wiki/BitTorrent_tracker

this is a point of weakness for torrents. do you think that we could use the redundancy of the blockchain to address this critical point? perhaps the client could abstract tracking information from the blockchain and loopback to find a locally stored tracker that is derived from information in the blockchain.
Its only for Mac for now

ooh yea i dont have mac. thats the only major OS i cant do.
Logged

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #29 on: April 14, 2014, 05:25:58 pm »

http://en.wikipedia.org/wiki/BitTorrent_tracker

this is a point of weakness for torrents. do you think that we could use the redundancy of the blockchain to address this critical point? perhaps the client could abstract tracking information from the blockchain and loopback to find a locally stored tracker that is derived from information in the blockchain.
Well, sure, but if you were worried about blockchain bloat from the AM's from NXTorrent fields, you will not like that each tracker would need to generate a periodic AM (if it even fits in one), otherwise it will become useless over time. How long a tracker's data is valid for, I have no idea.

If this was a separate project, I am sure I can come up with some sort of practical way of maximizing practical value of tracker data delivered vs. blockchain space used.

James

probably should be something like a stretch goal. maybe something someone can come back and do later. there are a ton of trackers out there. it may be the weakest point but its still not very weak.
Logged

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #30 on: April 15, 2014, 02:51:16 am »

Seeing that GUI development time is the bottleneck, I semi-automated generating the forms to submit to the websockets API.
It is just text, but it lets webdevs to start from a working syntax. It still takes about 10 minutes per form, but no point in spending 10 times more time to squeeze out the last minutes of work.

The following page has the current set of API's for NXTorrent.

http://209.126.71.170/api.html

I will upload a new version soon.

James

Edit: new version is at http://209.126.71.170/NXTorrent_01.zip, only for Mac
« Last Edit: April 15, 2014, 02:55:03 am by jl777 »
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #31 on: April 15, 2014, 03:11:54 am »

Seeing that GUI development time is the bottleneck, I semi-automated generating the forms to submit to the websockets API.
It is just text, but it lets webdevs to start from a working syntax. It still takes about 10 minutes per form, but no point in spending 10 times more time to squeeze out the last minutes of work.

The following page has the current set of API's for NXTorrent.

http://209.126.71.170/api.html

I will upload a new version soon.

James

Edit: new version is at http://209.126.71.170/NXTorrent_01.zip, only for Mac

super awesome. im very excited.

i was thinking about how to do categories. i was thinking that there is no way for us to impose categories onto other people. we want to avoid dictating to people. i was thinking that we should just have a section were a seller can list his item as part of any category he likes and then as many sub categories as he likes as well filled out with anything he likes. then on the client end we just filter what ever we dont like. so for example we may chose to display only the 100 categories with the most items for sale in them. and then then a similar rule of 20 for sub categories and sub-sub categories. ect. there would be pressure on sellers to conform to standards and norms that would organically develop since listing his shoes under the category "amusement park rides" would not be conducive to him actually making a sale. its sort of self governing.

anyway i know im jumping ahead but some questions about this were raised earlier so i thought i would give it a mention.
Logged

PoofKnuckle

  • Hero Member
  • *****
  • Karma: +111/-7
  • Offline Offline
  • Posts: 849
  • Your Concern is Noted.
    • View Profile
    • NXT FreeMarket
Re: NXTorrent
« Reply #32 on: April 15, 2014, 03:25:35 am »

eBay sells a lot of stuff, and people are used to them. We could start with the same set of categories they have, or a realistic subset. With their years of experience and budget, they have sort of done this work for us.

We could include a free form category field for sellers who are feeling rebellious.
Logged
NXT: NXT-WBVP-83YM-FRB3-9MQLY
BM-NBTVHaA41Ejh2G6krD9p5vM62vk84isM

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #33 on: April 15, 2014, 03:53:12 am »

eBay sells a lot of stuff, and people are used to them. We could start with the same set of categories they have, or a realistic subset. With their years of experience and budget, they have sort of done this work for us.

We could include a free form category field for sellers who are feeling rebellious.

I'm very confident the solution I proposed will work well.
Logged

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #34 on: April 15, 2014, 03:57:49 am »

Seeing that GUI development time is the bottleneck, I semi-automated generating the forms to submit to the websockets API.
It is just text, but it lets webdevs to start from a working syntax. It still takes about 10 minutes per form, but no point in spending 10 times more time to squeeze out the last minutes of work.

The following page has the current set of API's for NXTorrent.

http://209.126.71.170/api.html

I will upload a new version soon.

James

Edit: new version is at http://209.126.71.170/NXTorrent_01.zip, only for Mac

super awesome. im very excited.

i was thinking about how to do categories. i was thinking that there is no way for us to impose categories onto other people. we want to avoid dictating to people. i was thinking that we should just have a section were a seller can list his item as part of any category he likes and then as many sub categories as he likes as well filled out with anything he likes. then on the client end we just filter what ever we dont like. so for example we may chose to display only the 100 categories with the most items for sale in them. and then then a similar rule of 20 for sub categories and sub-sub categories. ect. there would be pressure on sellers to conform to standards and norms that would organically develop since listing his shoes under the category "amusement park rides" would not be conducive to him actually making a sale. its sort of self governing.

anyway i know im jumping ahead but some questions about this were raised earlier so i thought i would give it a mention.
Things are setup in the API so that you pass in an array of filters and these filter can be anything. Similarity with the listing, there is no restriction on what fields or values that can be used. I guess the one thing we can do is help with heirarchical organization instead of intersections of flat global categories.

Anyway, now that testnet is working, I need to shift to 100% multigateway and nothing but multigateway until it is done.
I think I pushed this project pretty close to the finish line in a day! Now it is time for others to develop bug lists (I am sure there have to be plenty) and desired features. Please try to get the list by Wed, I have some time available then.

James

P.S. I just had a crazy idea. Not sure if there will be any point, but what do you think about realtime auctions?
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #35 on: April 15, 2014, 04:49:27 am »

Seeing that GUI development time is the bottleneck, I semi-automated generating the forms to submit to the websockets API.
It is just text, but it lets webdevs to start from a working syntax. It still takes about 10 minutes per form, but no point in spending 10 times more time to squeeze out the last minutes of work.

The following page has the current set of API's for NXTorrent.

http://209.126.71.170/api.html

I will upload a new version soon.

James

Edit: new version is at http://209.126.71.170/NXTorrent_01.zip, only for Mac

super awesome. im very excited.

i was thinking about how to do categories. i was thinking that there is no way for us to impose categories onto other people. we want to avoid dictating to people. i was thinking that we should just have a section were a seller can list his item as part of any category he likes and then as many sub categories as he likes as well filled out with anything he likes. then on the client end we just filter what ever we dont like. so for example we may chose to display only the 100 categories with the most items for sale in them. and then then a similar rule of 20 for sub categories and sub-sub categories. ect. there would be pressure on sellers to conform to standards and norms that would organically develop since listing his shoes under the category "amusement park rides" would not be conducive to him actually making a sale. its sort of self governing.

anyway i know im jumping ahead but some questions about this were raised earlier so i thought i would give it a mention.
Things are setup in the API so that you pass in an array of filters and these filter can be anything. Similarity with the listing, there is no restriction on what fields or values that can be used. I guess the one thing we can do is help with heirarchical organization instead of intersections of flat global categories.

Anyway, now that testnet is working, I need to shift to 100% multigateway and nothing but multigateway until it is done.
I think I pushed this project pretty close to the finish line in a day! Now it is time for others to develop bug lists (I am sure there have to be plenty) and desired features. Please try to get the list by Wed, I have some time available then.

James

P.S. I just had a crazy idea. Not sure if there will be any point, but what do you think about realtime auctions?

Yes thats right. we need a way to express and interpret hierarchy in categories. also i think category field should be differentiated from tags, which are also a useful thing.

I didn't specify anything about platforms in my bounty thread and i really should have but how do you feel about windows mac and linux (at least ubuntu)? those three platforms cover almost all users.

also don't forget that part of this bounty, and part of the reason why its set so high (ateast i think its pretty high) is the bit at the end where im going to be a major pain in everyones ass. :D so just start to get prepared for that. (ill try not to be too bad i just want it to at-least approximately look as nice and feel as slick in operation as bitmit did)

any idea on an eta for multigateway? it can be pretty rough just a general idea ya know.

yea auctions would be cool. im trying to keep it from getting out of hand by limiting the total number of features. there is already going to be so much work to be done to get it to the level of a product that consumers actually want to use. maybe ill go back and fund stretch goals after the fact.

thanks for all the help so far!
Logged

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: NXTorrent
« Reply #36 on: April 15, 2014, 04:57:58 am »

Seeing that GUI development time is the bottleneck, I semi-automated generating the forms to submit to the websockets API.
It is just text, but it lets webdevs to start from a working syntax. It still takes about 10 minutes per form, but no point in spending 10 times more time to squeeze out the last minutes of work.

The following page has the current set of API's for NXTorrent.

http://209.126.71.170/api.html

I will upload a new version soon.

James

Edit: new version is at http://209.126.71.170/NXTorrent_01.zip, only for Mac

super awesome. im very excited.

i was thinking about how to do categories. i was thinking that there is no way for us to impose categories onto other people. we want to avoid dictating to people. i was thinking that we should just have a section were a seller can list his item as part of any category he likes and then as many sub categories as he likes as well filled out with anything he likes. then on the client end we just filter what ever we dont like. so for example we may chose to display only the 100 categories with the most items for sale in them. and then then a similar rule of 20 for sub categories and sub-sub categories. ect. there would be pressure on sellers to conform to standards and norms that would organically develop since listing his shoes under the category "amusement park rides" would not be conducive to him actually making a sale. its sort of self governing.

anyway i know im jumping ahead but some questions about this were raised earlier so i thought i would give it a mention.
Things are setup in the API so that you pass in an array of filters and these filter can be anything. Similarity with the listing, there is no restriction on what fields or values that can be used. I guess the one thing we can do is help with heirarchical organization instead of intersections of flat global categories.

Anyway, now that testnet is working, I need to shift to 100% multigateway and nothing but multigateway until it is done.
I think I pushed this project pretty close to the finish line in a day! Now it is time for others to develop bug lists (I am sure there have to be plenty) and desired features. Please try to get the list by Wed, I have some time available then.

James

P.S. I just had a crazy idea. Not sure if there will be any point, but what do you think about realtime auctions?

Yes thats right. we need a way to express and interpret hierarchy in categories. also i think category field should be differentiated from tags, which are also a useful thing.

I didn't specify anything about platforms in my bounty thread and i really should have but how do you feel about windows mac and linux (at least ubuntu)? those three platforms cover almost all users.

also don't forget that part of this bounty, and part of the reason why its set so high (ateast i think its pretty high) is the bit at the end where im going to be a major pain in everyones ass. :D so just start to get prepared for that. (ill try not to be too bad i just want it to at-least approximately look as nice and feel as slick in operation as bitmit did)

any idea on an eta for multigateway? it can be pretty rough just a general idea ya know.

yea auctions would be cool. im trying to keep it from getting out of hand by limiting the total number of features. there is already going to be so much work to be done to get it to the level of a product that consumers actually want to use. maybe ill go back and fund stretch goals after the fact.

thanks for all the help so far!
There is a reason I dont do GUIs :)
I prefer to stay out of subjective areas, so go wild and harass the GUI guys
I've been stalled for two weeks on multigateway due to all the testnet resets and problems, but it finally looks like it is working well. I figure a few days to get all the main paths tested and debugged, then a week to deal with issues raised by code review. The review is happening now starting with the parts that have been stable.

So, barring any surprises around two weeks, or about the same time as AE goes live. I still have to deal with porting websockets to ubuntu (should be easy) and windows (yuk!). I agree that ubuntu, Mac and Windows are the platforms that we need to support

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

PoofKnuckle

  • Hero Member
  • *****
  • Karma: +111/-7
  • Offline Offline
  • Posts: 849
  • Your Concern is Noted.
    • View Profile
    • NXT FreeMarket
Re: NXTorrent
« Reply #37 on: April 15, 2014, 05:26:24 pm »



I'm very confident the solution I proposed will work well.

OK, I have changed my test GUI to have 3 categories (hard-coded to three for now, since it's faster to test - I can make this into an all-you-can-type affair later). These are free-form fields, you can type in whatever you want.

This does raise some interface issues. For instance, if I am about to post my kitten for sale, I may wonder what category/categories to put him in. Users will need to know what the top categories are. Is "Cats" a category? How about "Pets?" Maybe "Annoying Animals?"

Also, some form of autocomplete might be helpful, so if I start typing "Small" the UI will show me that "Small Furry Things" is a category that exists, or has existed, or that currently has other items listed in it. That could also help with people typing "Small furry things" when they should have typed "Small Furry Things." In general, free form fields present issues for databases, so while you want to let people type in anything they want, there's nothing wrong with giving some feedback to help them get their items into the consensus categories that develop over time.
Logged
NXT: NXT-WBVP-83YM-FRB3-9MQLY
BM-NBTVHaA41Ejh2G6krD9p5vM62vk84isM

IveBeenBit

  • Full Member
  • ***
  • Karma: +7/-2
  • Offline Offline
  • Posts: 131
    • View Profile
Re: NXTorrent
« Reply #38 on: April 15, 2014, 05:54:25 pm »

Yes thats right. we need a way to express and interpret hierarchy in categories. also i think category field should be differentiated from tags, which are also a useful thing.

I didn't specify anything about platforms in my bounty thread and i really should have but how do you feel about windows mac and linux (at least ubuntu)? those three platforms cover almost all users.

also don't forget that part of this bounty, and part of the reason why its set so high (ateast i think its pretty high) is the bit at the end where im going to be a major pain in everyones ass. :D so just start to get prepared for that. (ill try not to be too bad i just want it to at-least approximately look as nice and feel as slick in operation as bitmit did)

any idea on an eta for multigateway? it can be pretty rough just a general idea ya know.

yea auctions would be cool. im trying to keep it from getting out of hand by limiting the total number of features. there is already going to be so much work to be done to get it to the level of a product that consumers actually want to use. maybe ill go back and fund stretch goals after the fact.

thanks for all the help so far!

Anon -- I just wanted to say I really like the way you seem to be managing this project. Keep up the good work, and don't be afraid to be strict. As you say, there's real money on the line, so a half assed job shouldn't cut it, IMO.
Logged
I need your suggestions for Nxt Podcast ideas. Click here and speak your mind!

anon136

  • Hero Member
  • *****
  • Karma: +86/-19
  • Offline Offline
  • Posts: 1015
    • View Profile
Re: NXTorrent
« Reply #39 on: April 15, 2014, 08:24:38 pm »



I'm very confident the solution I proposed will work well.

OK, I have changed my test GUI to have 3 categories (hard-coded to three for now, since it's faster to test - I can make this into an all-you-can-type affair later). These are free-form fields, you can type in whatever you want.

This does raise some interface issues. For instance, if I am about to post my kitten for sale, I may wonder what category/categories to put him in. Users will need to know what the top categories are. Is "Cats" a category? How about "Pets?" Maybe "Annoying Animals?"

Also, some form of autocomplete might be helpful, so if I start typing "Small" the UI will show me that "Small Furry Things" is a category that exists, or has existed, or that currently has other items listed in it. That could also help with people typing "Small furry things" when they should have typed "Small Furry Things." In general, free form fields present issues for databases, so while you want to let people type in anything they want, there's nothing wrong with giving some feedback to help them get their items into the consensus categories that develop over time.

Well you look through all the ones that already exist. Or the top 100 or how ever many are being displayed by default in most peoples interfaces. If you like one of them than you use it. If you don't than you make it the way you think it ought to be. A kitten would be a tough one. Probably just pets with no sub category. But inside of pets would be other subcategories like clothing, or medicine ect... You just wouldn't even use one of those sub categories if you were actually selling a pet. Though i could be wrong. Maybe something else appropriate would evolve naturally and i would just go with that.

and yea for all that other stuff about auto complete and giving people feedback in terms of the consensus categories. that sounds wonderful.
Logged
Pages: 1 [2] 3 4 ... 9  All
 

elective-stereophonic
elective-stereophonic
assembly
assembly