Nxt Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

Latest Nxt Client 1.11.5 - NEW RELEASE: Ardor 2.0.3e TestNet IS LAUNCHED!

Pages: [1]

Author Topic: PeerExplorer.com what should we monitor?  (Read 4624 times)

crimi

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 883
    • View Profile
  • Karma: +122/-11
PeerExplorer.com what should we monitor?
April 18, 2014, 02:50:09 pm

Hi@all,

First off all i suspended the cache system because i was unhappy that it would push me to develop peerexplorer in a certain direction that i never wanted. NXT is a bad coin for donations because it has 0% inflation! That is really not good in case of growing something. With a high inflation people are forced to spend there coins (its like holding a hot potatoe), dogecoin and there community doing great stuff. So 0% inflation will always makes it attractive for hoarding it.

How to sponsor nodes is really not easy(even nodecoin you have to sell somebody on a exchange)! Because all coins even bitcoin have this problems and they are sirious. This articel is pretty hitting it. https://www.counterparty.co/full-bitcoin-nodes/
I also followed recently on bitbucket a discussion about nodes sponsoring and why nodes are importent. I think this quote will answer the question in case of bitcoin and any other cryptocurrency.

Quote
There is more to maintaining the Bitcoin network than mining – miners validate transactions, but those transactions need to be relayed across the network. The relaying of transactions is done by full nodes; without full nodes, there is no Bitcoin.
The problem is that while miners are rewarded for processing transactions, full node operators are not rewarded for relaying them. In the earlier days of Bitcoin, this was not an issue because the two were often one and the same. However, with the arrival of pooled mining, most people that operate bitcoin mining equipment are not full node operators. The result is that full nodes have become a neglected aspect of participating in the Bitcoin ecosystem.

Mainly i will work in future on the visualisation of the network. Alltogether it will be a website everyone should understand and worth showing on a conference etc...

Question to the communtiy is what we want to monitor? I dont think that it would make a lot of sence to order 10 vps and check cpu and mem, specially when it is centralised. Everything on external data that it is not included in the NRS core weakens the whole project. Fails external data from a centralised source could lead to market manipulation and even more uncertainty. That could do even more harm.

I read here always to monitor forks..... I think we will all know very fast when we are having more than one chain.... In all cases i heard about forks happen to coins it was because of client changes to a new wallet or to less mining power in proof of work system (double spend). When we are on a fork it is already to late and it was because everyone wasnt changing fast enough to a new version. With a active community such a false chain does not really have a long lifetime. For monitoring TPS we dont need a whole project ^^.

Finally i dont apply here for a bounty because it is hard to say what is something worth. What was more worth than any NXT in the world that amichaelix from NXT tech funding committee reached out for me and just asked about how the project is doing. 

I just want to give the infrastructure committee my thoughts.

Dont blow NXT on people they want to run nodes like nxtbase and need NXT for running and managing it (What do you do if you have no bounty anymore, he will stop operating them anyway. It is better you find 100 people that are willing to run 1 node than paying 1 man to run 100 nodes!)! Dont blow NXT on people they want to create a network monitor that is not 100 % opensource part of NRS core! Better donate small amounts of NXT over a long period of time to people that are having the spirit to work on NXT projects and have already something to show.

Cheers crimi
« Last Edit: April 18, 2014, 03:13:13 pm by crimi »
PeerExplorer.com | NodeExplorer.com

EvilDave

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1790
    • View Profile
    • NXT Foundation
  • Karma: +341/-40

Crimi: Thanks for the input, bro.
Firstly, I just want to say thanks for providing peerexplorer.com......it's a damn useful tool for NXT.
More network visualisation would be good.....

Node sponsoring is one of the things we need to address soon. Theres been a lot of discussion about various schemes, but consensus on a plan is still some way off.  We do need to find a way to make running forging nodes profitable on a stand alone basis. Big NXT holders have the incentive to run nodes, based on the value that will add to NXT and their own holdings, but right now small holders have no real incentive to run forging nodes.

On the question of what to monitor, we've already been discussing this on the InfCom bitbucket:
https://bitbucket.org/nxtinfrastructure/committee/issues?status=new&status=open

TPS has a theoretical maximum, I'd like to see something that can measure the real TPS rate over a period. We've all seen how sometimes a block can drag out to 10 or 15 minutes, what are the causes of these slow blocks?

Lastly: we let a load of VPS hosted nodes drop out at the end of last month, which seems to have had little effect on the NXTwork.

Thanks for the thoughts, stay in touch...



 
Nulli Dei, nulli Reges, solum NXT
NXT Donations: NXT-BNZB-9V8M-XRPW-3S3WD
We will ride eternal, shiny and chrome!

crimi

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 883
    • View Profile
  • Karma: +122/-11

There are always around 40 nodes that have permission to open api, so you could fetch the stats and look for any abnormal behavior. Normaly you will find nodes that are crashed.

http://www.peerexplorer.com/nodecompare.php


On bitbucket that post is quite intresting:

Quote
marcus03
I remembered that CfB and BCNext were monitoring the NXT network when we were under DDOS and asked him how they did it. Here's his answer:
"We had nodes in different datacenters. All these nodes were connected to Nxt network (to different peers!) and had direct connections to each other. Once a node received a block or an unconfirmed transaction it sent this to other nodes (not Nxt peers). The others measured time between the signal and time when they received the same block/transaction from Nxt peers. The delay is the main indicator that shows time of network convergence. During DDoS attacks average convergence time becomes much higher. Forks r also easily detected.
We also measure load on other peers by sending transactions to one of them from one node and receiving on another one. U can easily extended this approach and add extra functionality.
We used tool written by BCNext and I can't share it without his explicit permission, which is hard to get coz I'm not in touch with him anymore."

But that sounds only a solution if you have control over the servers.
PeerExplorer.com | NodeExplorer.com

jl777

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 6176
    • View Profile
  • Karma: +718/-123

There are always around 40 nodes that have permission to open api, so you could fetch the stats and look for any abnormal behavior. Normaly you will find nodes that are crashed.

http://www.peerexplorer.com/nodecompare.php


On bitbucket that post is quite intresting:

Quote
marcus03
I remembered that CfB and BCNext were monitoring the NXT network when we were under DDOS and asked him how they did it. Here's his answer:
"We had nodes in different datacenters. All these nodes were connected to Nxt network (to different peers!) and had direct connections to each other. Once a node received a block or an unconfirmed transaction it sent this to other nodes (not Nxt peers). The others measured time between the signal and time when they received the same block/transaction from Nxt peers. The delay is the main indicator that shows time of network convergence. During DDoS attacks average convergence time becomes much higher. Forks r also easily detected.
We also measure load on other peers by sending transactions to one of them from one node and receiving on another one. U can easily extended this approach and add extra functionality.
We used tool written by BCNext and I can't share it without his explicit permission, which is hard to get coz I'm not in touch with him anymore."

But that sounds only a solution if you have control over the servers.
Thanks for this quote!
It confirms my ideas on NXThealth monitor that I will build into nodeminer,which will be included with all the other NXTprotocol handlers, eg. NXTorrent, InstantDEX, NXTsubatomic, etc.

It will be decentralized

Separately, we need to rethink what a "transaction" is. With some of my upcoming releases, 1000TPS will not be a problem at all, in fact a lot larger number could easily be achieved. The trick is that they are not all recorded in the blockchain. We can have 1000TPS and not have blockchain bloat!

Nodes that dont participate in the high TPS activity (InstantDEX) wont even know it is happening, but they are

So if a transaction falls in the forest and doesnt appear in the blockchain,did it happen?

James
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

farl4bit

  • Global Moderator
  • Hero Member
  • *****
  • Offline Offline
  • Posts: 3369
  • Go Nxt!
    • View Profile
    • Blockchain Startpagina
  • Karma: +204/-45

Too bad Peerexplorer.com stopped. It was my motivation to hire more nodes. I think I will keep them and fund them myself.

devphp

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1229
    • View Profile
  • Karma: +87/-14

Don't know if this is a relevant thread, but can peerexplorer please show the height each node is at in the table? It would be handy if there is no browser access allowed and you need to quickly check if your node is at the right height as seen by others.

devphp

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1229
    • View Profile
  • Karma: +87/-14

can peerexplorer please show the height each node is at in the table?

please? :'(

farl4bit

  • Global Moderator
  • Hero Member
  • *****
  • Offline Offline
  • Posts: 3369
  • Go Nxt!
    • View Profile
    • Blockchain Startpagina
  • Karma: +204/-45

I cannot search for the name of the node anymore, only on ip-adress. Why is that stopped?

crimi

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 883
    • View Profile
  • Karma: +122/-11

can peerexplorer please show the height each node is at in the table?

please? :'(

I can integrate this for all peers with openapi. I dont really have a lot of space in the table left, so i will try to fit it in to the status row... next days.

I cannot search for the name of the node anymore, only on ip-adress. Why is that stopped?

I replaced the dns with isp, i will integrate that you can search for your dns again... next days.

Thanks for your feedback
« Last Edit: June 28, 2014, 02:42:34 pm by crimi »
PeerExplorer.com | NodeExplorer.com

EvilDave

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1790
    • View Profile
    • NXT Foundation
  • Karma: +341/-40

Crimi: again, thanks for your brilliant work on PeerExplorer....I'm spending far too much time looking at it these days.

Is it possible to monitor the effective account balance forging on each node ? Being able to see this would be very useful.
Nulli Dei, nulli Reges, solum NXT
NXT Donations: NXT-BNZB-9V8M-XRPW-3S3WD
We will ride eternal, shiny and chrome!

crimi

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 883
    • View Profile
  • Karma: +122/-11

Thanks EvilDave.

I thought about this as well quite some time. I will look into it.
PeerExplorer.com | NodeExplorer.com

Daedelus

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 3281
    • View Profile
  • Karma: +230/-12

Is http://peerexplorer.com accurate at the moment?

It is only showing 85 peers to me  :-\
NXT: NXT-4CS7-S4N5-PTH5-A8R2Q

rriky92

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 84
    • View Profile
  • Karma: +9/-1
Re: PeerExplorer.com what should we monitor?
September 13, 2014, 05:18:18 pm

there is an issue with API:

http://www.peerexplorer.com/api_openapi displays also offline nodes and not in order by the Weight.

Using http://jsonlint.com you can also check there is some issue with JSON so i can't use your API.
iOS & Website Developer - iNxt - Hallmarked node - NXT-8T4Z-6NRS-PBGB-6UWU9

slothbag

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 454
    • View Profile
  • Karma: +74/-4
Re: PeerExplorer.com what should we monitor?
September 17, 2014, 01:21:58 am

What about monitoring port 7876.. show open API nodes.. could be useful for lightweight clients to be able to transact without running a full node.. i.e. smartphones etc

rriky92

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 84
    • View Profile
  • Karma: +9/-1
Re: PeerExplorer.com what should we monitor?
September 17, 2014, 10:22:20 am

What about monitoring port 7876.. show open API nodes.. could be useful for lightweight clients to be able to transact without running a full node.. i.e. smartphones etc

Peerexplorer already show Open API nodes
iOS & Website Developer - iNxt - Hallmarked node - NXT-8T4Z-6NRS-PBGB-6UWU9

slothbag

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 454
    • View Profile
  • Karma: +74/-4
Re: PeerExplorer.com what should we monitor?
September 17, 2014, 10:32:41 am

What about monitoring port 7876.. show open API nodes.. could be useful for lightweight clients to be able to transact without running a full node.. i.e. smartphones etc

Peerexplorer already show Open API nodes

So it does, great work :)

altsheets

  • Full Member
  • ***
  • Offline Offline
  • Posts: 231
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1

If this is (not) an official peerexplorer thread
- I could not find any by search --> in topic subjects only -,
(then where is it) then I want to point to an issue & and make a suggestion:

Using yesterday's blockchain download, the marketplace disappeared.
See my posting, and Jean-Luc's answer.

Secondly what about giving a random of the Top nodes from the
"nodes with open API, hallmark and latest version" list as:
http://www.peerexplorer.com/api_random and
http://www.peerexplorer.com/random clickable.

I was presenting NXT to total supernoobs, and for simplicity
I thought it would be nice to be able to just open any "web wallet";
and such an api extension & new page would do the trick perfectly.

Thirdly, really not your business, but in the same session I was longing for
a working (without-registration) faucet which gives 2 NXT to play with. No?


And most importantly: Great site & service, thx! Keep up the good work!

« Last Edit: August 05, 2015, 01:26:52 am by altsheets »
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more | dividends soon paid in AAssetNXT & AAssetHZ, autumn/winter 2016

jl777

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 6176
    • View Profile
  • Karma: +718/-123

If this is (not) an official peerexplorer thread
- I could not find any by search --> in topic subjects only -,
(then where is it) then I want to point to an issue & and make a suggestion:

Using yesterday's blockchain download, the marketplace disappeared.
See my posting, and Jean-Luc's answer.

Secondly what about giving a random of the Top nodes from the
"nodes with open API, hallmark and latest version" as:
http://www.peerexplorer.com/random and
http://www.peerexplorer.com/api_random

I was presenting NXT to total supernoobs, and for simplicity
I thought it would be nice to be able to just open any "web wallet";
and such an api extension & new page would do the trick perfectly.

Thirdly, really not your business, but in the same session I was longing for
a working (without-registration) faucet which gives 2 NXT to play with.


And most importantly: Great site & service, thx! Keep up the good work!
the new MGW will allow to create a deposit address for any NXT address (even brand new one) and then you can deposit small amount of BTC which will initialize the pubkey for the account along with up to 100 NXT
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

altsheets

  • Full Member
  • ***
  • Offline Offline
  • Posts: 231
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1

Thx, jl777. Cool. That will help for sure.

But imagine: They were such supernoobs that they do not even own BTC yet.
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more | dividends soon paid in AAssetNXT & AAssetHZ, autumn/winter 2016
Pages: [1]