GNUnet  0.11.x
Data Structures | Macros | Functions | Variables
gnunet-service-zonemaster.c File Reference

publish records from namestore to GNUnet name system More...

#include "platform.h"
#include "gnunet_util_lib.h"
#include "gnunet_dnsparser_lib.h"
#include "gnunet_dht_service.h"
#include "gnunet_namestore_service.h"
#include "gnunet_statistics_service.h"
Include dependency graph for gnunet-service-zonemaster.c:

Go to the source code of this file.

Data Structures

struct  DhtPutActivity
 Handle for DHT PUT activity triggered from the namestore monitor. More...
 

Macros

#define LOG_STRERROR_FILE(kind, syscall, filename)
 
#define PUBLISH_OPS_PER_EXPIRATION   4
 How often should we (re)publish each record before it expires? More...
 
#define DELTA_INTERVAL   100
 How often do we measure the delta between desired zone iteration speed and actual speed, and tell statistics service about it? More...
 
#define NS_BLOCK_SIZE   1000
 How many records do we fetch in one shot from the namestore? More...
 
#define DHT_QUEUE_LIMIT   2000
 How many pending DHT operations do we allow at most? More...
 
#define NAMESTORE_QUEUE_LIMIT   50
 How many events may the namestore give us before it has to wait for us to keep up? More...
 
#define INITIAL_ZONE_ITERATION_INTERVAL   GNUNET_TIME_UNIT_MILLISECONDS
 The initial interval in milliseconds btween puts in a zone iteration. More...
 
#define MAXIMUM_ZONE_ITERATION_INTERVAL
 The upper bound for the zone iteration interval (per record). More...
 
#define LATE_ITERATION_SPEEDUP_FACTOR   2
 The factor the current zone iteration interval is divided by for each additional new record. More...
 
#define DHT_GNS_REPLICATION_LEVEL   5
 What replication level do we use for DHT PUT operations? More...
 

Functions

static void shutdown_task (void *cls)
 Task run during shutdown. More...
 
static void publish_zone_namestore_next (void *cls)
 Method called periodically that triggers iteration over authoritative records. More...
 
static void publish_zone_dht_start (void *cls)
 Periodically iterate over our zone and store everything in dht. More...
 
static void calculate_put_interval ()
 Calculate target_iteration_velocity_per_record. More...
 
static void update_velocity (unsigned int cnt)
 Re-calculate our velocity and the desired velocity. More...
 
static void check_zone_namestore_next ()
 Check if the current zone iteration needs to be continued by calling publish_zone_namestore_next(), and if so with what delay. More...
 
static void dht_put_continuation (void *cls)
 Continuation called from DHT once the PUT operation is done. More...
 
static unsigned int convert_records_for_export (const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count, struct GNUNET_GNSRECORD_Data *rd_public)
 Convert namestore records from the internal format to that suitable for publication (removes private records, converts to absolute expiration time). More...
 
static struct GNUNET_DHT_PutHandleperform_dht_put (const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, const struct GNUNET_GNSRECORD_Data *rd_public, unsigned int rd_public_count, struct DhtPutActivity *ma)
 Store GNS records in the DHT. More...
 
static void zone_iteration_error (void *cls)
 We encountered an error in our zone iteration. More...
 
static void zone_iteration_finished (void *cls)
 Zone iteration is completed. More...
 
static void put_gns_record (void *cls, const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, unsigned int rd_count, const struct GNUNET_GNSRECORD_Data *rd)
 Function used to put all records successively into the DHT. More...
 
static void run (void *cls, const struct GNUNET_CONFIGURATION_Handle *c, struct GNUNET_SERVICE_Handle *service)
 Performe zonemaster duties: watch namestore, publish records. More...
 
 GNUNET_SERVICE_MAIN ("zonemaster", GNUNET_SERVICE_OPTION_NONE, &run, NULL, NULL, NULL, GNUNET_MQ_handler_end())
 Define "main" method using service macro. More...
 

Variables

static struct GNUNET_STATISTICS_Handlestatistics
 Handle to the statistics service. More...
 
static struct GNUNET_DHT_Handledht_handle
 Our handle to the DHT. More...
 
static struct GNUNET_NAMESTORE_Handlenamestore_handle
 Our handle to the namestore service. More...
 
static struct GNUNET_NAMESTORE_ZoneIteratornamestore_iter
 Handle to iterate over our authoritative zone in namestore. More...
 
static struct DhtPutActivityit_head
 Head of iteration put activities; kept in a DLL. More...
 
static struct DhtPutActivityit_tail
 Tail of iteration put activities; kept in a DLL. More...
 
static unsigned int dht_queue_length
 Number of entries in the DHT queue it_head. More...
 
static unsigned long long num_public_records
 Useful for zone update for DHT put. More...
 
static unsigned long long last_num_public_records
 Last seen record count. More...
 
static unsigned long long put_cnt
 Number of successful put operations performed in the current measurement cycle (as measured in check_zone_namestore_next()). More...
 
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
 What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone. More...
 
static struct GNUNET_TIME_Relative min_relative_record_time
 Minimum relative expiration time of records seem during the current zone iteration. More...
 
static struct GNUNET_TIME_Relative last_min_relative_record_time
 Minimum relative expiration time of records seem during the last zone iteration. More...
 
static struct GNUNET_TIME_Relative zone_publish_time_window_default
 Default time window for zone iteration. More...
 
static struct GNUNET_TIME_Relative zone_publish_time_window
 Time window for zone iteration, adjusted based on relative record expiration times in our zone. More...
 
static struct GNUNET_TIME_Absolute last_put_100
 When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculations. More...
 
static struct GNUNET_TIME_Relative sub_delta
 By how much should we try to increase our per-record iteration speed (over the desired speed calculated directly from the #put_interval)? Basically this value corresponds to the per-record CPU time overhead we have. More...
 
static struct GNUNET_SCHEDULER_Taskzone_publish_task
 zone publish task More...
 
static unsigned int ns_iteration_left
 How many more values are left for the current query before we need to explicitly ask the namestore for more? More...
 
static int first_zone_iteration
 GNUNET_YES if zone has never been published before More...
 
static int cache_keys
 Optimize block insertion by caching map of private keys to public keys in memory? More...
 

Detailed Description

publish records from namestore to GNUnet name system

Author
Christian Grothoff

Definition in file gnunet-service-zonemaster.c.

Macro Definition Documentation

◆ LOG_STRERROR_FILE

#define LOG_STRERROR_FILE (   kind,
  syscall,
  filename 
)
Value:
syscall, \
#define GNUNET_log_from_strerror_file(level, component, cmd, filename)
Log an error message at log-level 'level' that indicates a failure of the command 'cmd' with the mess...
static char * filename

Definition at line 34 of file gnunet-service-zonemaster.c.

◆ PUBLISH_OPS_PER_EXPIRATION

#define PUBLISH_OPS_PER_EXPIRATION   4

How often should we (re)publish each record before it expires?

Definition at line 44 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval().

◆ DELTA_INTERVAL

#define DELTA_INTERVAL   100

How often do we measure the delta between desired zone iteration speed and actual speed, and tell statistics service about it?

Definition at line 51 of file gnunet-service-zonemaster.c.

Referenced by put_gns_record().

◆ NS_BLOCK_SIZE

#define NS_BLOCK_SIZE   1000

How many records do we fetch in one shot from the namestore?

Definition at line 56 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), and publish_zone_namestore_next().

◆ DHT_QUEUE_LIMIT

#define DHT_QUEUE_LIMIT   2000

How many pending DHT operations do we allow at most?

Definition at line 61 of file gnunet-service-zonemaster.c.

Referenced by put_gns_record().

◆ NAMESTORE_QUEUE_LIMIT

#define NAMESTORE_QUEUE_LIMIT   50

How many events may the namestore give us before it has to wait for us to keep up?

Definition at line 67 of file gnunet-service-zonemaster.c.

◆ INITIAL_ZONE_ITERATION_INTERVAL

#define INITIAL_ZONE_ITERATION_INTERVAL   GNUNET_TIME_UNIT_MILLISECONDS

The initial interval in milliseconds btween puts in a zone iteration.

Definition at line 73 of file gnunet-service-zonemaster.c.

Referenced by run().

◆ MAXIMUM_ZONE_ITERATION_INTERVAL

#define MAXIMUM_ZONE_ITERATION_INTERVAL
Value:
#define GNUNET_TIME_UNIT_MINUTES
One minute.
struct GNUNET_TIME_Relative GNUNET_TIME_relative_multiply(struct GNUNET_TIME_Relative rel, unsigned long long factor)
Multiply relative time by a given factor.
Definition: time.c:442

The upper bound for the zone iteration interval (per record).

Definition at line 79 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and check_zone_namestore_next().

◆ LATE_ITERATION_SPEEDUP_FACTOR

#define LATE_ITERATION_SPEEDUP_FACTOR   2

The factor the current zone iteration interval is divided by for each additional new record.

Definition at line 86 of file gnunet-service-zonemaster.c.

Referenced by update_velocity().

◆ DHT_GNS_REPLICATION_LEVEL

#define DHT_GNS_REPLICATION_LEVEL   5

What replication level do we use for DHT PUT operations?

Definition at line 91 of file gnunet-service-zonemaster.c.

Referenced by perform_dht_put().

Function Documentation

◆ shutdown_task()

static void shutdown_task ( void *  cls)
static

Task run during shutdown.

Parameters
clsunused
tcunused

Definition at line 248 of file gnunet-service-zonemaster.c.

References dht_queue_length, GNUNET_CONTAINER_DLL_remove, GNUNET_DHT_disconnect(), GNUNET_DHT_put_cancel(), GNUNET_ERROR_TYPE_DEBUG, GNUNET_free, GNUNET_log, GNUNET_NAMESTORE_disconnect(), GNUNET_NAMESTORE_zone_iteration_stop(), GNUNET_NO, GNUNET_SCHEDULER_cancel(), GNUNET_STATISTICS_destroy(), and DhtPutActivity::ph.

Referenced by run().

249 {
250  struct DhtPutActivity *ma;
251 
252  (void) cls;
254  "Shutting down!\n");
255  while (NULL != (ma = it_head))
256  {
260  it_tail,
261  ma);
263  GNUNET_free (ma);
264  }
265  if (NULL != statistics)
266  {
268  GNUNET_NO);
269  statistics = NULL;
270  }
271  if (NULL != zone_publish_task)
272  {
274  zone_publish_task = NULL;
275  }
276  if (NULL != namestore_iter)
277  {
279  namestore_iter = NULL;
280  }
281  if (NULL != namestore_handle)
282  {
284  namestore_handle = NULL;
285  }
286  if (NULL != dht_handle)
287  {
289  dht_handle = NULL;
290  }
291 }
#define GNUNET_CONTAINER_DLL_remove(head, tail, element)
Remove an element from a DLL.
struct GNUNET_DHT_PutHandle * ph
Handle for the DHT PUT operation.
void GNUNET_DHT_put_cancel(struct GNUNET_DHT_PutHandle *ph)
Cancels a DHT PUT operation.
Definition: dht_api.c:1035
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
#define GNUNET_NO
Definition: gnunet_common.h:78
static struct DhtPutActivity * it_tail
Tail of iteration put activities; kept in a DLL.
void GNUNET_STATISTICS_destroy(struct GNUNET_STATISTICS_Handle *h, int sync_first)
Destroy a handle (free all state associated with it).
Handle for DHT PUT activity triggered from the namestore monitor.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
void GNUNET_NAMESTORE_disconnect(struct GNUNET_NAMESTORE_Handle *h)
Disconnect from the namestore service (and free associated resources).
void GNUNET_NAMESTORE_zone_iteration_stop(struct GNUNET_NAMESTORE_ZoneIterator *it)
Stops iteration and releases the namestore handle for further calls.
static struct DhtPutActivity * it_head
Head of iteration put activities; kept in a DLL.
static struct GNUNET_DHT_Handle * dht_handle
Our handle to the DHT.
void GNUNET_DHT_disconnect(struct GNUNET_DHT_Handle *handle)
Shutdown connection with the DHT service.
Definition: dht_api.c:918
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static struct GNUNET_NAMESTORE_Handle * namestore_handle
Our handle to the namestore service.
#define GNUNET_log(kind,...)
#define GNUNET_free(ptr)
Wrapper around free.
void * GNUNET_SCHEDULER_cancel(struct GNUNET_SCHEDULER_Task *task)
Cancel the task with the specified identifier.
Definition: scheduler.c:966
Here is the call graph for this function:
Here is the caller graph for this function:

◆ publish_zone_namestore_next()

static void publish_zone_namestore_next ( void *  cls)
static

Method called periodically that triggers iteration over authoritative records.

Parameters
clsNULL

Definition at line 300 of file gnunet-service-zonemaster.c.

References GNUNET_assert, GNUNET_NAMESTORE_zone_iterator_next(), NS_BLOCK_SIZE, ns_iteration_left, and publish_zone_dht_start().

Referenced by check_zone_namestore_next().

301 {
302  (void) cls;
303  zone_publish_task = NULL;
304  GNUNET_assert (NULL != namestore_iter);
308  NS_BLOCK_SIZE);
309 }
#define NS_BLOCK_SIZE
How many records do we fetch in one shot from the namestore?
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
void GNUNET_NAMESTORE_zone_iterator_next(struct GNUNET_NAMESTORE_ZoneIterator *it, uint64_t limit)
Calls the record processor specified in GNUNET_NAMESTORE_zone_iteration_start for the next record...
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
Here is the call graph for this function:
Here is the caller graph for this function:

◆ publish_zone_dht_start()

static void publish_zone_dht_start ( void *  cls)
static

Periodically iterate over our zone and store everything in dht.

Periodically iterate over all zones and store everything in DHT.

Parameters
clsNULL

Definition at line 798 of file gnunet-service-zonemaster.c.

References GNUNET_assert, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NAMESTORE_zone_iteration_start(), GNUNET_NO, GNUNET_STATISTICS_update(), ns_iteration_left, num_public_records, put_gns_record(), zone_iteration_error(), and zone_iteration_finished().

Referenced by publish_zone_namestore_next(), run(), zone_iteration_error(), and zone_iteration_finished().

799 {
800  (void) cls;
801  zone_publish_task = NULL;
803  "Full zone iterations launched",
804  1,
805  GNUNET_NO);
807  "Starting DHT zone update!\n");
808  /* start counting again */
809  num_public_records = 0;
810  GNUNET_assert (NULL == namestore_iter);
811  ns_iteration_left = 1;
814  NULL, /* All zones */
816  NULL,
818  NULL,
820  NULL);
821  GNUNET_assert (NULL != namestore_iter);
822 }
struct GNUNET_NAMESTORE_ZoneIterator * GNUNET_NAMESTORE_zone_iteration_start(struct GNUNET_NAMESTORE_Handle *h, const struct GNUNET_CRYPTO_EcdsaPrivateKey *zone, GNUNET_SCHEDULER_TaskCallback error_cb, void *error_cb_cls, GNUNET_NAMESTORE_RecordMonitor proc, void *proc_cls, GNUNET_SCHEDULER_TaskCallback finish_cb, void *finish_cb_cls)
Starts a new zone iteration (used to periodically PUT all of our records into our DHT)...
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
static void zone_iteration_error(void *cls)
We encountered an error in our zone iteration.
#define GNUNET_NO
Definition: gnunet_common.h:78
void GNUNET_STATISTICS_update(struct GNUNET_STATISTICS_Handle *handle, const char *name, int64_t delta, int make_persistent)
Set statistic value for the peer.
static unsigned long long num_public_records
Useful for zone update for DHT put.
static void put_gns_record(void *cls, const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, unsigned int rd_count, const struct GNUNET_GNSRECORD_Data *rd)
Function used to put all records successively into the DHT.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
static struct GNUNET_NAMESTORE_Handle * namestore_handle
Our handle to the namestore service.
#define GNUNET_log(kind,...)
static void zone_iteration_finished(void *cls)
Zone iteration is completed.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ calculate_put_interval()

static void calculate_put_interval ( )
static

Calculate target_iteration_velocity_per_record.

If no records are known (startup) or none present we can safely set the interval to the value for a single record

Definition at line 325 of file gnunet-service-zonemaster.c.

References GNUNET_ERROR_TYPE_BULK, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NO, GNUNET_STATISTICS_set(), GNUNET_TIME_relative_divide(), GNUNET_TIME_relative_min(), last_min_relative_record_time, last_num_public_records, MAXIMUM_ZONE_ITERATION_INTERVAL, min_relative_record_time, num_public_records, PUBLISH_OPS_PER_EXPIRATION, GNUNET_TIME_Relative::rel_value_us, target_iteration_velocity_per_record, zone_publish_time_window, and zone_publish_time_window_default.

Referenced by update_velocity(), and zone_iteration_finished().

326 {
327  if (0 == num_public_records)
335  "No records in namestore database.\n");
336  }
337  else
338  {
350  }
355  "Minimum relative record expiration (in μs)",
357  GNUNET_NO);
359  "Zone publication time window (in μs)",
361  GNUNET_NO);
363  "Target zone iteration velocity (μs)",
365  GNUNET_NO);
366 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
uint64_t rel_value_us
The actual value.
static unsigned long long last_num_public_records
Last seen record count.
static struct GNUNET_TIME_Relative zone_publish_time_window
Time window for zone iteration, adjusted based on relative record expiration times in our zone...
static struct GNUNET_TIME_Relative zone_publish_time_window_default
Default time window for zone iteration.
#define GNUNET_NO
Definition: gnunet_common.h:78
#define PUBLISH_OPS_PER_EXPIRATION
How often should we (re)publish each record before it expires?
static struct GNUNET_TIME_Relative last_min_relative_record_time
Minimum relative expiration time of records seem during the last zone iteration.
static unsigned long long num_public_records
Useful for zone update for DHT put.
#define MAXIMUM_ZONE_ITERATION_INTERVAL
The upper bound for the zone iteration interval (per record).
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Relative GNUNET_TIME_relative_min(struct GNUNET_TIME_Relative t1, struct GNUNET_TIME_Relative t2)
Return the minimum of two relative time values.
Definition: time.c:272
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
#define GNUNET_log(kind,...)
struct GNUNET_TIME_Relative GNUNET_TIME_relative_divide(struct GNUNET_TIME_Relative rel, unsigned long long factor)
Divide relative time by a given factor.
Definition: time.c:527
Here is the call graph for this function:
Here is the caller graph for this function:

◆ update_velocity()

static void update_velocity ( unsigned int  cnt)
static

Re-calculate our velocity and the desired velocity.

We have succeeded in making DELTA_INTERVAL puts, so now calculate the new desired delay between puts.

Parameters
cnthow many records were processed since the last call?

Definition at line 377 of file gnunet-service-zonemaster.c.

References calculate_put_interval(), dht_queue_length, first_zone_iteration, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NO, GNUNET_STATISTICS_set(), GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_absolute_get(), GNUNET_TIME_absolute_get_duration(), GNUNET_TIME_relative_add(), GNUNET_TIME_relative_subtract(), GNUNET_TIME_UNIT_ZERO, GNUNET_YES, last_num_public_records, last_put_100, LATE_ITERATION_SPEEDUP_FACTOR, num_public_records, GNUNET_TIME_Relative::rel_value_us, sub_delta, and target_iteration_velocity_per_record.

Referenced by check_zone_namestore_next(), and put_gns_record().

378 {
380  unsigned long long pct = 0;
381 
382  if (0 == cnt)
383  return;
384  /* How fast were we really? */
386  delta.rel_value_us /= cnt;
388 
389  /* calculate expected frequency */
392  {
394  "Last record count was lower than current record count. Reducing interval.\n");
398  }
400  "Desired global zone iteration interval is %s/record!\n",
403  GNUNET_YES));
404 
405  /* Tell statistics actual vs. desired speed */
407  "Current zone iteration velocity (μs/record)",
409  GNUNET_NO);
410  /* update "sub_delta" based on difference, taking
411  previous sub_delta into account! */
413  {
414  /* We were too fast, reduce sub_delta! */
415  struct GNUNET_TIME_Relative corr;
416 
418  delta);
420  {
421  /* Reduce sub_delta by corr */
423  corr);
424  }
425  else
426  {
427  /* We're doing fine with waiting the full time, this
428  should theoretically only happen if we run at
429  infinite speed. */
431  }
432  }
435  {
436  /* We were too slow, increase sub_delta! */
437  struct GNUNET_TIME_Relative corr;
438 
442  corr);
443  if (sub_delta.rel_value_us >
445  {
446  /* CPU overload detected, we cannot go at desired speed,
447  as this would mean using a negative delay. */
448  /* compute how much faster we would want to be for
449  the desired velocity */
451  pct = UINT64_MAX; /* desired speed is infinity ... */
452  else
453  pct = (sub_delta.rel_value_us
457  }
458  }
460  "# size of the DHT queue (it)",
462  GNUNET_NO);
464  "% speed increase needed for target velocity",
465  pct,
466  GNUNET_NO);
468  "# records processed in current iteration",
470  GNUNET_NO);
471 }
uint64_t rel_value_us
The actual value.
static struct GNUNET_TIME_Relative delta
Definition: speedup.c:35
static unsigned long long last_num_public_records
Last seen record count.
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
#define GNUNET_NO
Definition: gnunet_common.h:78
static unsigned long long num_public_records
Useful for zone update for DHT put.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
#define LATE_ITERATION_SPEEDUP_FACTOR
The factor the current zone iteration interval is divided by for each additional new record...
static void calculate_put_interval()
Calculate target_iteration_velocity_per_record.
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:687
static struct GNUNET_TIME_Relative sub_delta
By how much should we try to increase our per-record iteration speed (over the desired speed calculat...
struct GNUNET_TIME_Relative GNUNET_TIME_relative_subtract(struct GNUNET_TIME_Relative a1, struct GNUNET_TIME_Relative a2)
Subtract relative timestamp from the other.
Definition: time.c:604
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
#define GNUNET_TIME_UNIT_ZERO
Relative time zero.
struct GNUNET_TIME_Relative GNUNET_TIME_relative_add(struct GNUNET_TIME_Relative a1, struct GNUNET_TIME_Relative a2)
Add relative times together.
Definition: time.c:579
struct GNUNET_TIME_Relative GNUNET_TIME_absolute_get_duration(struct GNUNET_TIME_Absolute whence)
Get the duration of an operation as the difference of the current time and the given start time "henc...
Definition: time.c:375
#define GNUNET_log(kind,...)
static struct GNUNET_TIME_Absolute last_put_100
When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculatio...
#define GNUNET_YES
Definition: gnunet_common.h:77
Time for relative time used by GNUnet, in microseconds.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ check_zone_namestore_next()

static void check_zone_namestore_next ( )
static

Check if the current zone iteration needs to be continued by calling publish_zone_namestore_next(), and if so with what delay.

Definition at line 479 of file gnunet-service-zonemaster.c.

References first_zone_iteration, GNUNET_assert, GNUNET_NO, GNUNET_SCHEDULER_add_delayed(), GNUNET_STATISTICS_set(), GNUNET_TIME_relative_min(), GNUNET_TIME_relative_multiply(), GNUNET_TIME_relative_subtract(), GNUNET_TIME_UNIT_ZERO, GNUNET_YES, MAXIMUM_ZONE_ITERATION_INTERVAL, NS_BLOCK_SIZE, ns_iteration_left, publish_zone_namestore_next(), put_cnt, GNUNET_TIME_Relative::rel_value_us, sub_delta, target_iteration_velocity_per_record, and update_velocity().

Referenced by put_gns_record().

480 {
482 
483  if (0 != ns_iteration_left)
484  return; /* current NAMESTORE iteration not yet done */
486  put_cnt = 0;
488  sub_delta);
489  /* We delay *once* per #NS_BLOCK_SIZE, so we need to multiply the
490  per-record delay calculated so far with the #NS_BLOCK_SIZE */
492  "Current artificial NAMESTORE delay (μs/record)",
494  GNUNET_NO);
496  NS_BLOCK_SIZE);
497  /* make sure we do not overshoot because of the #NS_BLOCK_SIZE factor */
499  delay);
500  /* no delays on first iteration */
506  NULL);
507 }
#define NS_BLOCK_SIZE
How many records do we fetch in one shot from the namestore?
uint64_t rel_value_us
The actual value.
static void update_velocity(unsigned int cnt)
Re-calculate our velocity and the desired velocity.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
static void publish_zone_namestore_next(void *cls)
Method called periodically that triggers iteration over authoritative records.
#define GNUNET_NO
Definition: gnunet_common.h:78
#define MAXIMUM_ZONE_ITERATION_INTERVAL
The upper bound for the zone iteration interval (per record).
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_delayed(struct GNUNET_TIME_Relative delay, GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run with a specified delay.
Definition: scheduler.c:1253
static struct GNUNET_TIME_Relative sub_delta
By how much should we try to increase our per-record iteration speed (over the desired speed calculat...
struct GNUNET_TIME_Relative GNUNET_TIME_relative_multiply(struct GNUNET_TIME_Relative rel, unsigned long long factor)
Multiply relative time by a given factor.
Definition: time.c:442
struct GNUNET_TIME_Relative GNUNET_TIME_relative_subtract(struct GNUNET_TIME_Relative a1, struct GNUNET_TIME_Relative a2)
Subtract relative timestamp from the other.
Definition: time.c:604
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Relative GNUNET_TIME_relative_min(struct GNUNET_TIME_Relative t1, struct GNUNET_TIME_Relative t2)
Return the minimum of two relative time values.
Definition: time.c:272
static struct GNUNET_TIME_Relative delay
When should dkg communication start?
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
#define GNUNET_TIME_UNIT_ZERO
Relative time zero.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
static unsigned long long put_cnt
Number of successful put operations performed in the current measurement cycle (as measured in check_...
#define GNUNET_YES
Definition: gnunet_common.h:77
Time for relative time used by GNUnet, in microseconds.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ dht_put_continuation()

static void dht_put_continuation ( void *  cls)
static

Continuation called from DHT once the PUT operation is done.

Parameters
clsa struct DhtPutActivity

Definition at line 516 of file gnunet-service-zonemaster.c.

References dht_queue_length, GNUNET_CONTAINER_DLL_remove, GNUNET_ERROR_TYPE_DEBUG, GNUNET_free, and GNUNET_log.

Referenced by perform_dht_put().

517 {
518  struct DhtPutActivity *ma = cls;
519 
521  "PUT complete\n");
524  it_tail,
525  ma);
526  GNUNET_free (ma);
527 }
#define GNUNET_CONTAINER_DLL_remove(head, tail, element)
Remove an element from a DLL.
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
static struct DhtPutActivity * it_tail
Tail of iteration put activities; kept in a DLL.
Handle for DHT PUT activity triggered from the namestore monitor.
static struct DhtPutActivity * it_head
Head of iteration put activities; kept in a DLL.
#define GNUNET_log(kind,...)
#define GNUNET_free(ptr)
Wrapper around free.
Here is the caller graph for this function:

◆ convert_records_for_export()

static unsigned int convert_records_for_export ( const struct GNUNET_GNSRECORD_Data rd,
unsigned int  rd_count,
struct GNUNET_GNSRECORD_Data rd_public 
)
static

Convert namestore records from the internal format to that suitable for publication (removes private records, converts to absolute expiration time).

Parameters
rdinput records
rd_countsize of the rd and rd_public arrays
rd_publicwhere to write the converted records
Returns
number of records written to rd_public

Definition at line 541 of file gnunet-service-zonemaster.c.

References GNUNET_TIME_Absolute::abs_value_us, GNUNET_GNSRECORD_RF_PRIVATE, GNUNET_GNSRECORD_RF_RELATIVE_EXPIRATION, GNUNET_MIN, GNUNET_TIME_absolute_get(), min_relative_record_time, and GNUNET_TIME_Relative::rel_value_us.

Referenced by put_gns_record().

544 {
545  struct GNUNET_TIME_Absolute now;
546  unsigned int rd_public_count;
547 
548  rd_public_count = 0;
549  now = GNUNET_TIME_absolute_get ();
550  for (unsigned int i = 0; i < rd_count; i++)
551  {
552  if (0 != (rd[i].flags & GNUNET_GNSRECORD_RF_PRIVATE))
553  continue;
554  if ((0 == (rd[i].flags & GNUNET_GNSRECORD_RF_RELATIVE_EXPIRATION)) &&
555  (rd[i].expiration_time < now.abs_value_us))
556  continue; /* record already expired, skip it */
557  if (0 != (rd[i].flags & GNUNET_GNSRECORD_RF_RELATIVE_EXPIRATION))
558  {
559  /* GNUNET_GNSRECORD_block_create will convert to absolute time;
560  we just need to adjust our iteration frequency */
562  GNUNET_MIN (rd[i].expiration_time,
564  }
565  rd_public[rd_public_count++] = rd[i];
566  }
567  return rd_public_count;
568 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
uint64_t rel_value_us
The actual value.
#define GNUNET_MIN(a, b)
Definition: gnunet_common.h:80
This is a private record of this peer and it should thus not be handed out to other peers...
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
Time for absolute times used by GNUnet, in microseconds.
This flag is currently unused; former RF_PENDING flag.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ perform_dht_put()

static struct GNUNET_DHT_PutHandle* perform_dht_put ( const struct GNUNET_CRYPTO_EcdsaPrivateKey key,
const char *  label,
const struct GNUNET_GNSRECORD_Data rd_public,
unsigned int  rd_public_count,
struct DhtPutActivity ma 
)
static

Store GNS records in the DHT.

Parameters
keykey of the zone
labellabel to store under
rd_publicpublic record data
rd_public_countnumber of records in rd_public
mahandle for the put operation
Returns
DHT PUT handle, NULL on error

Definition at line 582 of file gnunet-service-zonemaster.c.

References cache_keys, DHT_GNS_REPLICATION_LEVEL, dht_put_continuation(), GNUNET_BLOCK_TYPE_GNS_NAMERECORD, GNUNET_break, GNUNET_DHT_put(), GNUNET_DHT_RO_DEMULTIPLEX_EVERYWHERE, GNUNET_ERROR_TYPE_DEBUG, GNUNET_free, GNUNET_GNSRECORD_block_create(), GNUNET_GNSRECORD_block_create2(), GNUNET_GNSRECORD_query_from_private_key(), GNUNET_GNSRECORD_record_get_expiration_time(), GNUNET_h2s(), GNUNET_log, GNUNET_NO, GNUNET_STATISTICS_update(), GNUNET_STRINGS_absolute_time_to_string(), num_public_records, GNUNET_GNSRECORD_Block::purpose, ret, and GNUNET_CRYPTO_EccSignaturePurpose::size.

Referenced by put_gns_record().

587 {
588  struct GNUNET_GNSRECORD_Block *block;
589  struct GNUNET_HashCode query;
591  size_t block_size;
592  struct GNUNET_DHT_PutHandle *ret;
593 
595  rd_public);
596  if (cache_keys)
597  block = GNUNET_GNSRECORD_block_create2 (key,
598  expire,
599  label,
600  rd_public,
601  rd_public_count);
602  else
603  block = GNUNET_GNSRECORD_block_create (key,
604  expire,
605  label,
606  rd_public,
607  rd_public_count);
608  if (NULL == block)
609  {
610  GNUNET_break (0);
611  return NULL; /* whoops */
612  }
613  block_size = ntohl (block->purpose.size)
614  + sizeof(struct GNUNET_CRYPTO_EcdsaSignature)
615  + sizeof(struct GNUNET_CRYPTO_EcdsaPublicKey);
617  label,
618  &query);
620  "DHT put operations initiated",
621  1,
622  GNUNET_NO);
624  "Storing %u record(s) for label `%s' in DHT with expiration `%s' under key %s\n",
625  rd_public_count,
626  label,
628  GNUNET_h2s (&query));
630  ret = GNUNET_DHT_put (dht_handle,
631  &query,
635  block_size,
636  block,
637  expire,
639  ma);
640  GNUNET_free (block);
641  return ret;
642 }
static void dht_put_continuation(void *cls)
Continuation called from DHT once the PUT operation is done.
struct GNUNET_GNSRECORD_Block * GNUNET_GNSRECORD_block_create(const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, struct GNUNET_TIME_Absolute expire, const char *label, const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count)
Sign name and records.
static void expire(void *cls)
Expire a PooledConnection object.
struct GNUNET_GNSRECORD_Block * GNUNET_GNSRECORD_block_create2(const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, struct GNUNET_TIME_Absolute expire, const char *label, const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count)
Sign name and records, cache derived public key (also keeps the private key in static memory...
static int ret
Return value of the commandline.
Definition: gnunet-abd.c:81
#define GNUNET_NO
Definition: gnunet_common.h:78
const char * GNUNET_h2s(const struct GNUNET_HashCode *hc)
Convert a hash value to a string (for printing debug messages).
Information we have in an encrypted block with record data (i.e.
void GNUNET_STATISTICS_update(struct GNUNET_STATISTICS_Handle *handle, const char *name, int64_t delta, int make_persistent)
Set statistic value for the peer.
static unsigned long long num_public_records
Useful for zone update for DHT put.
#define GNUNET_break(cond)
Use this for internal assertion violations that are not fatal (can be handled) but should not occur...
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
void GNUNET_GNSRECORD_query_from_private_key(const struct GNUNET_CRYPTO_EcdsaPrivateKey *zone, const char *label, struct GNUNET_HashCode *query)
Calculate the DHT query for a given label in a given zone.
#define DHT_GNS_REPLICATION_LEVEL
What replication level do we use for DHT PUT operations?
an ECC signature using ECDSA
uint32_t size
How many bytes does this signature sign? (including this purpose header); in network byte order (!)...
Block for storing record data.
A 512-bit hashcode.
struct GNUNET_TIME_Absolute GNUNET_GNSRECORD_record_get_expiration_time(unsigned int rd_count, const struct GNUNET_GNSRECORD_Data *rd)
Returns the expiration time of the given block of records.
struct GNUNET_DHT_PutHandle * GNUNET_DHT_put(struct GNUNET_DHT_Handle *handle, const struct GNUNET_HashCode *key, uint32_t desired_replication_level, enum GNUNET_DHT_RouteOption options, enum GNUNET_BLOCK_Type type, size_t size, const void *data, struct GNUNET_TIME_Absolute exp, GNUNET_SCHEDULER_TaskCallback cont, void *cont_cls)
Perform a PUT operation storing data in the DHT.
Definition: dht_api.c:966
static struct GNUNET_DHT_Handle * dht_handle
Our handle to the DHT.
static int cache_keys
Optimize block insertion by caching map of private keys to public keys in memory? ...
Handle to a PUT request.
Definition: dht_api.c:43
Public ECC key (always for Curve25519) encoded in a format suitable for network transmission and ECDS...
#define GNUNET_log(kind,...)
Time for absolute times used by GNUnet, in microseconds.
const char * GNUNET_STRINGS_absolute_time_to_string(struct GNUNET_TIME_Absolute t)
Like asctime, except for GNUnet time.
Definition: strings.c:742
struct GNUNET_CRYPTO_EccSignaturePurpose purpose
Number of bytes signed; also specifies the number of bytes of encrypted data that follow...
Each peer along the way should look at &#39;enc&#39; (otherwise only the k-peers closest to the key should lo...
#define GNUNET_free(ptr)
Wrapper around free.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ zone_iteration_error()

static void zone_iteration_error ( void *  cls)
static

We encountered an error in our zone iteration.

Parameters
clsNULL

Definition at line 651 of file gnunet-service-zonemaster.c.

References GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_SCHEDULER_add_now(), GNUNET_SCHEDULER_cancel(), and publish_zone_dht_start().

Referenced by publish_zone_dht_start().

652 {
653  (void) cls;
655  "Got disconnected from namestore database, retrying.\n");
656  namestore_iter = NULL;
657  /* We end up here on error/disconnect/shutdown, so potentially
658  while a zone publish task or a DHT put is still running; hence
659  we need to cancel those. */
660  if (NULL != zone_publish_task)
661  {
663  zone_publish_task = NULL;
664  }
666  NULL);
667 }
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_now(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run as soon as possible.
Definition: scheduler.c:1280
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static void publish_zone_dht_start(void *cls)
Periodically iterate over our zone and store everything in dht.
#define GNUNET_log(kind,...)
void * GNUNET_SCHEDULER_cancel(struct GNUNET_SCHEDULER_Task *task)
Cancel the task with the specified identifier.
Definition: scheduler.c:966
Here is the call graph for this function:
Here is the caller graph for this function:

◆ zone_iteration_finished()

static void zone_iteration_finished ( void *  cls)
static

Zone iteration is completed.

Parameters
clsNULL

Definition at line 676 of file gnunet-service-zonemaster.c.

References calculate_put_interval(), first_zone_iteration, GNUNET_assert, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NO, GNUNET_SCHEDULER_add_delayed(), GNUNET_SCHEDULER_add_now(), GNUNET_STATISTICS_set(), GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_UNIT_FOREVER_REL, GNUNET_YES, last_min_relative_record_time, last_num_public_records, min_relative_record_time, num_public_records, publish_zone_dht_start(), GNUNET_TIME_Relative::rel_value_us, and target_iteration_velocity_per_record.

Referenced by publish_zone_dht_start().

677 {
678  (void) cls;
679  /* we're done with one iteration, calculate when to do the next one */
680  namestore_iter = NULL;
685  /* reset for next iteration */
689  "Zone iteration finished. Adjusted zone iteration interval to %s\n",
692  GNUNET_YES));
694  "Target zone iteration velocity (μs)",
696  GNUNET_NO);
698  "Number of public records in DHT",
700  GNUNET_NO);
702  if (0 == last_num_public_records)
703  {
707  NULL);
708  }
709  else
710  {
712  NULL);
713  }
714 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
uint64_t rel_value_us
The actual value.
static unsigned long long last_num_public_records
Last seen record count.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
#define GNUNET_NO
Definition: gnunet_common.h:78
static struct GNUNET_TIME_Relative last_min_relative_record_time
Minimum relative expiration time of records seem during the last zone iteration.
static unsigned long long num_public_records
Useful for zone update for DHT put.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_delayed(struct GNUNET_TIME_Relative delay, GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run with a specified delay.
Definition: scheduler.c:1253
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_now(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run as soon as possible.
Definition: scheduler.c:1280
static void calculate_put_interval()
Calculate target_iteration_velocity_per_record.
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:687
#define GNUNET_TIME_UNIT_FOREVER_REL
Constant used to specify "forever".
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static void publish_zone_dht_start(void *cls)
Periodically iterate over our zone and store everything in dht.
#define GNUNET_log(kind,...)
#define GNUNET_YES
Definition: gnunet_common.h:77
Here is the call graph for this function:
Here is the caller graph for this function:

◆ put_gns_record()

static void put_gns_record ( void *  cls,
const struct GNUNET_CRYPTO_EcdsaPrivateKey key,
const char *  label,
unsigned int  rd_count,
const struct GNUNET_GNSRECORD_Data rd 
)
static

Function used to put all records successively into the DHT.

Parameters
clsthe closure (NULL)
keythe private key of the authority (ours)
labelthe name of the records, NULL once the iteration is done
rd_countthe number of records in rd
rdthe record data

Definition at line 727 of file gnunet-service-zonemaster.c.

References check_zone_namestore_next(), convert_records_for_export(), DELTA_INTERVAL, dht_queue_length, DHT_QUEUE_LIMIT, GNUNET_CONTAINER_DLL_insert_tail, GNUNET_CONTAINER_DLL_remove, GNUNET_DHT_put_cancel(), GNUNET_ERROR_TYPE_DEBUG, GNUNET_ERROR_TYPE_WARNING, GNUNET_free, GNUNET_log, GNUNET_new, GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_absolute_get(), GNUNET_TIME_absolute_get_duration(), GNUNET_YES, it_head, ns_iteration_left, perform_dht_put(), DhtPutActivity::ph, put_cnt, DhtPutActivity::start_date, and update_velocity().

Referenced by publish_zone_dht_start().

732 {
733  struct GNUNET_GNSRECORD_Data rd_public[rd_count];
734  unsigned int rd_public_count;
735  struct DhtPutActivity *ma;
736 
737  (void) cls;
739  rd_public_count = convert_records_for_export (rd,
740  rd_count,
741  rd_public);
742  if (0 == rd_public_count)
743  {
745  "Record set empty, moving to next record set\n");
747  return;
748  }
749  /* We got a set of records to publish */
751  "Starting DHT PUT\n");
752  ma = GNUNET_new (struct DhtPutActivity);
754  ma->ph = perform_dht_put (key,
755  label,
756  rd_public,
757  rd_public_count,
758  ma);
759  put_cnt++;
760  if (0 == put_cnt % DELTA_INTERVAL)
761  update_velocity (DELTA_INTERVAL);
763  if (NULL == ma->ph)
764  {
766  "Could not perform DHT PUT, is the DHT running?\n");
767  GNUNET_free (ma);
768  return;
769  }
772  it_tail,
773  ma);
775  {
776  ma = it_head;
778  it_tail,
779  ma);
783  "DHT PUT unconfirmed after %s, aborting PUT\n",
786  GNUNET_YES));
787  GNUNET_free (ma);
788  }
789 }
#define GNUNET_CONTAINER_DLL_remove(head, tail, element)
Remove an element from a DLL.
struct GNUNET_DHT_PutHandle * ph
Handle for the DHT PUT operation.
void GNUNET_DHT_put_cancel(struct GNUNET_DHT_PutHandle *ph)
Cancels a DHT PUT operation.
Definition: dht_api.c:1035
static void update_velocity(unsigned int cnt)
Re-calculate our velocity and the desired velocity.
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
#define DELTA_INTERVAL
How often do we measure the delta between desired zone iteration speed and actual speed...
static struct GNUNET_DHT_PutHandle * perform_dht_put(const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, const struct GNUNET_GNSRECORD_Data *rd_public, unsigned int rd_public_count, struct DhtPutActivity *ma)
Store GNS records in the DHT.
struct GNUNET_TIME_Absolute start_date
When was this PUT initiated?
#define GNUNET_new(type)
Allocate a struct or union of the given type.
static struct DhtPutActivity * it_tail
Tail of iteration put activities; kept in a DLL.
Handle for DHT PUT activity triggered from the namestore monitor.
static unsigned int convert_records_for_export(const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count, struct GNUNET_GNSRECORD_Data *rd_public)
Convert namestore records from the internal format to that suitable for publication (removes private ...
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:687
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
#define DHT_QUEUE_LIMIT
How many pending DHT operations do we allow at most?
static struct DhtPutActivity * it_head
Head of iteration put activities; kept in a DLL.
#define GNUNET_CONTAINER_DLL_insert_tail(head, tail, element)
Insert an element at the tail of a DLL.
static void check_zone_namestore_next()
Check if the current zone iteration needs to be continued by calling publish_zone_namestore_next(), and if so with what delay.
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
static unsigned long long put_cnt
Number of successful put operations performed in the current measurement cycle (as measured in check_...
struct GNUNET_TIME_Relative GNUNET_TIME_absolute_get_duration(struct GNUNET_TIME_Absolute whence)
Get the duration of an operation as the difference of the current time and the given start time "henc...
Definition: time.c:375
#define GNUNET_log(kind,...)
#define GNUNET_YES
Definition: gnunet_common.h:77
#define GNUNET_free(ptr)
Wrapper around free.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ run()

static void run ( void *  cls,
const struct GNUNET_CONFIGURATION_Handle c,
struct GNUNET_SERVICE_Handle service 
)
static

Performe zonemaster duties: watch namestore, publish records.

Parameters
clsclosure
serverthe initialized server
cconfiguration to use

Definition at line 833 of file gnunet-service-zonemaster.c.

References _, cache_keys, first_zone_iteration, GNUNET_CONFIGURATION_get_value_number(), GNUNET_CONFIGURATION_get_value_time(), GNUNET_CONFIGURATION_get_value_yesno(), GNUNET_DHT_connect(), GNUNET_DHT_DEFAULT_REPUBLISH_FREQUENCY, GNUNET_ERROR_TYPE_DEBUG, GNUNET_ERROR_TYPE_ERROR, GNUNET_log, GNUNET_MQ_handler_end, GNUNET_NAMESTORE_connect(), GNUNET_NO, GNUNET_OK, GNUNET_SCHEDULER_add_now(), GNUNET_SCHEDULER_add_shutdown(), GNUNET_SCHEDULER_shutdown(), GNUNET_SERVICE_MAIN(), GNUNET_SERVICE_OPTION_NONE, GNUNET_STATISTICS_create(), GNUNET_STATISTICS_set(), GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_absolute_get(), GNUNET_TIME_UNIT_FOREVER_REL, GNUNET_YES, INITIAL_ZONE_ITERATION_INTERVAL, last_put_100, min_relative_record_time, publish_zone_dht_start(), GNUNET_TIME_Relative::rel_value_us, shutdown_task(), target_iteration_velocity_per_record, zone_publish_time_window, and zone_publish_time_window_default.

836 {
837  unsigned long long max_parallel_bg_queries = 128;
838 
839  (void) cls;
840  (void) service;
841  last_put_100 = GNUNET_TIME_absolute_get (); /* first time! */
846  if (NULL == namestore_handle)
847  {
849  _ ("Failed to connect to the namestore!\n"));
851  return;
852  }
854  "namestore",
855  "CACHE_KEYS");
857  if (GNUNET_OK ==
859  "zonemaster",
860  "ZONE_PUBLISH_TIME_WINDOW",
862  {
864  "Time window for zone iteration: %s\n",
867  GNUNET_YES));
868  }
870  if (GNUNET_OK ==
872  "zonemaster",
873  "MAX_PARALLEL_BACKGROUND_QUERIES",
874  &max_parallel_bg_queries))
875  {
877  "Number of allowed parallel background queries: %llu\n",
878  max_parallel_bg_queries);
879  }
880  if (0 == max_parallel_bg_queries)
881  max_parallel_bg_queries = 1;
883  (unsigned int) max_parallel_bg_queries);
884  if (NULL == dht_handle)
885  {
887  _ ("Could not connect to DHT!\n"));
889  NULL);
890  return;
891  }
892 
893  /* Schedule periodic put for our records. */
895  statistics = GNUNET_STATISTICS_create ("zonemaster",
896  c);
898  "Target zone iteration velocity (μs)",
900  GNUNET_NO);
902  NULL);
904  NULL);
905 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
int GNUNET_CONFIGURATION_get_value_time(const struct GNUNET_CONFIGURATION_Handle *cfg, const char *section, const char *option, struct GNUNET_TIME_Relative *time)
Get a configuration value that should be a relative time.
int GNUNET_CONFIGURATION_get_value_number(const struct GNUNET_CONFIGURATION_Handle *cfg, const char *section, const char *option, unsigned long long *number)
Get a configuration value that should be a number.
uint64_t rel_value_us
The actual value.
static void shutdown_task(void *cls)
Task run during shutdown.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_shutdown(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run on shutdown, that is when a CTRL-C signal is received, or when GNUNET_SCHEDULER_shutdown() is being invoked.
Definition: scheduler.c:1300
struct GNUNET_STATISTICS_Handle * GNUNET_STATISTICS_create(const char *subsystem, const struct GNUNET_CONFIGURATION_Handle *cfg)
Get handle for the statistics service.
static struct GNUNET_TIME_Relative zone_publish_time_window
Time window for zone iteration, adjusted based on relative record expiration times in our zone...
static struct GNUNET_TIME_Relative zone_publish_time_window_default
Default time window for zone iteration.
#define GNUNET_NO
Definition: gnunet_common.h:78
#define GNUNET_OK
Named constants for return values.
Definition: gnunet_common.h:75
void GNUNET_SCHEDULER_shutdown(void)
Request the shutdown of a scheduler.
Definition: scheduler.c:526
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
#define _(String)
GNU gettext support macro.
Definition: platform.h:181
#define GNUNET_DHT_DEFAULT_REPUBLISH_FREQUENCY
Default republication frequency for stored data in the DHT.
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_now(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run as soon as possible.
Definition: scheduler.c:1280
#define INITIAL_ZONE_ITERATION_INTERVAL
The initial interval in milliseconds btween puts in a zone iteration.
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:687
#define GNUNET_TIME_UNIT_FOREVER_REL
Constant used to specify "forever".
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
struct GNUNET_DHT_Handle * GNUNET_DHT_connect(const struct GNUNET_CONFIGURATION_Handle *cfg, unsigned int ht_len)
Initialize the connection with the DHT service.
Definition: dht_api.c:890
static struct GNUNET_DHT_Handle * dht_handle
Our handle to the DHT.
struct GNUNET_NAMESTORE_Handle * GNUNET_NAMESTORE_connect(const struct GNUNET_CONFIGURATION_Handle *cfg)
Connect to the namestore service.
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static void publish_zone_dht_start(void *cls)
Periodically iterate over our zone and store everything in dht.
static int cache_keys
Optimize block insertion by caching map of private keys to public keys in memory? ...
static struct GNUNET_NAMESTORE_Handle * namestore_handle
Our handle to the namestore service.
#define GNUNET_log(kind,...)
static struct GNUNET_TIME_Absolute last_put_100
When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculatio...
#define GNUNET_YES
Definition: gnunet_common.h:77
int GNUNET_CONFIGURATION_get_value_yesno(const struct GNUNET_CONFIGURATION_Handle *cfg, const char *section, const char *option)
Get a configuration value that should be in a set of "YES" or "NO".
Here is the call graph for this function:

◆ GNUNET_SERVICE_MAIN()

GNUNET_SERVICE_MAIN ( "zonemaster"  ,
GNUNET_SERVICE_OPTION_NONE  ,
run,
NULL  ,
NULL  ,
NULL  ,
GNUNET_MQ_handler_end()   
)

Define "main" method using service macro.

Referenced by run().

Here is the caller graph for this function:

Variable Documentation

◆ statistics

struct GNUNET_STATISTICS_Handle* statistics
static

Handle to the statistics service.

Definition at line 124 of file gnunet-service-zonemaster.c.

◆ dht_handle

struct GNUNET_DHT_Handle* dht_handle
static

Our handle to the DHT.

Definition at line 129 of file gnunet-service-zonemaster.c.

◆ namestore_handle

struct GNUNET_NAMESTORE_Handle* namestore_handle
static

Our handle to the namestore service.

Definition at line 134 of file gnunet-service-zonemaster.c.

◆ namestore_iter

struct GNUNET_NAMESTORE_ZoneIterator* namestore_iter
static

Handle to iterate over our authoritative zone in namestore.

Definition at line 139 of file gnunet-service-zonemaster.c.

◆ it_head

struct DhtPutActivity* it_head
static

Head of iteration put activities; kept in a DLL.

Definition at line 144 of file gnunet-service-zonemaster.c.

Referenced by put_gns_record().

◆ it_tail

struct DhtPutActivity* it_tail
static

Tail of iteration put activities; kept in a DLL.

Definition at line 149 of file gnunet-service-zonemaster.c.

◆ dht_queue_length

unsigned int dht_queue_length
static

Number of entries in the DHT queue it_head.

Definition at line 154 of file gnunet-service-zonemaster.c.

Referenced by dht_put_continuation(), put_gns_record(), shutdown_task(), and update_velocity().

◆ num_public_records

unsigned long long num_public_records
static

Useful for zone update for DHT put.

Definition at line 159 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), perform_dht_put(), publish_zone_dht_start(), update_velocity(), and zone_iteration_finished().

◆ last_num_public_records

unsigned long long last_num_public_records
static

Last seen record count.

Definition at line 164 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), update_velocity(), and zone_iteration_finished().

◆ put_cnt

unsigned long long put_cnt
static

Number of successful put operations performed in the current measurement cycle (as measured in check_zone_namestore_next()).

Definition at line 170 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), and put_gns_record().

◆ target_iteration_velocity_per_record

struct GNUNET_TIME_Relative target_iteration_velocity_per_record
static

What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.

Definition at line 179 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), check_zone_namestore_next(), run(), update_velocity(), and zone_iteration_finished().

◆ min_relative_record_time

struct GNUNET_TIME_Relative min_relative_record_time
static

Minimum relative expiration time of records seem during the current zone iteration.

Definition at line 185 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), convert_records_for_export(), run(), and zone_iteration_finished().

◆ last_min_relative_record_time

struct GNUNET_TIME_Relative last_min_relative_record_time
static

Minimum relative expiration time of records seem during the last zone iteration.

Definition at line 191 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and zone_iteration_finished().

◆ zone_publish_time_window_default

struct GNUNET_TIME_Relative zone_publish_time_window_default
static

Default time window for zone iteration.

Definition at line 196 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and run().

◆ zone_publish_time_window

struct GNUNET_TIME_Relative zone_publish_time_window
static

Time window for zone iteration, adjusted based on relative record expiration times in our zone.

Definition at line 202 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and run().

◆ last_put_100

struct GNUNET_TIME_Absolute last_put_100
static

When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculations.

Definition at line 208 of file gnunet-service-zonemaster.c.

Referenced by run(), and update_velocity().

◆ sub_delta

struct GNUNET_TIME_Relative sub_delta
static

By how much should we try to increase our per-record iteration speed (over the desired speed calculated directly from the #put_interval)? Basically this value corresponds to the per-record CPU time overhead we have.

Definition at line 216 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), and update_velocity().

◆ zone_publish_task

struct GNUNET_SCHEDULER_Task* zone_publish_task
static

zone publish task

Definition at line 221 of file gnunet-service-zonemaster.c.

◆ ns_iteration_left

unsigned int ns_iteration_left
static

How many more values are left for the current query before we need to explicitly ask the namestore for more?

Definition at line 227 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), publish_zone_dht_start(), publish_zone_namestore_next(), and put_gns_record().

◆ first_zone_iteration

int first_zone_iteration
static

GNUNET_YES if zone has never been published before

Definition at line 232 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), run(), update_velocity(), and zone_iteration_finished().

◆ cache_keys

int cache_keys
static

Optimize block insertion by caching map of private keys to public keys in memory?

Definition at line 238 of file gnunet-service-zonemaster.c.

Referenced by perform_dht_put(), and run().