GNUnet  0.10.x
Data Structures | Macros | Functions | Variables
gnunet-service-zonemaster.c File Reference

publish records from namestore to GNUnet name system More...

#include "platform.h"
#include "gnunet_util_lib.h"
#include "gnunet_dnsparser_lib.h"
#include "gnunet_dht_service.h"
#include "gnunet_namestore_service.h"
#include "gnunet_statistics_service.h"
Include dependency graph for gnunet-service-zonemaster.c:

Go to the source code of this file.

Data Structures

struct  DhtPutActivity
 Handle for DHT PUT activity triggered from the namestore monitor. More...
 

Macros

#define LOG_STRERROR_FILE(kind, syscall, filename)   GNUNET_log_from_strerror_file(kind, "util", syscall, filename)
 
#define PUBLISH_OPS_PER_EXPIRATION   4
 How often should we (re)publish each record before it expires? More...
 
#define DELTA_INTERVAL   100
 How often do we measure the delta between desired zone iteration speed and actual speed, and tell statistics service about it? More...
 
#define NS_BLOCK_SIZE   1000
 How many records do we fetch in one shot from the namestore? More...
 
#define DHT_QUEUE_LIMIT   2000
 How many pending DHT operations do we allow at most? More...
 
#define NAMESTORE_QUEUE_LIMIT   50
 How many events may the namestore give us before it has to wait for us to keep up? More...
 
#define INITIAL_ZONE_ITERATION_INTERVAL   GNUNET_TIME_UNIT_MILLISECONDS
 The initial interval in milliseconds btween puts in a zone iteration. More...
 
#define MAXIMUM_ZONE_ITERATION_INTERVAL   GNUNET_TIME_relative_multiply(GNUNET_TIME_UNIT_MINUTES, 15)
 The upper bound for the zone iteration interval (per record). More...
 
#define LATE_ITERATION_SPEEDUP_FACTOR   2
 The factor the current zone iteration interval is divided by for each additional new record. More...
 
#define DHT_GNS_REPLICATION_LEVEL   5
 What replication level do we use for DHT PUT operations? More...
 

Functions

static void shutdown_task (void *cls)
 Task run during shutdown. More...
 
static void publish_zone_namestore_next (void *cls)
 Method called periodically that triggers iteration over authoritative records. More...
 
static void publish_zone_dht_start (void *cls)
 Periodically iterate over our zone and store everything in dht. More...
 
static void calculate_put_interval ()
 Calculate target_iteration_velocity_per_record. More...
 
static void update_velocity (unsigned int cnt)
 Re-calculate our velocity and the desired velocity. More...
 
static void check_zone_namestore_next ()
 Check if the current zone iteration needs to be continued by calling publish_zone_namestore_next(), and if so with what delay. More...
 
static void dht_put_continuation (void *cls)
 Continuation called from DHT once the PUT operation is done. More...
 
static unsigned int convert_records_for_export (const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count, struct GNUNET_GNSRECORD_Data *rd_public)
 Convert namestore records from the internal format to that suitable for publication (removes private records, converts to absolute expiration time). More...
 
static struct GNUNET_DHT_PutHandleperform_dht_put (const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, const struct GNUNET_GNSRECORD_Data *rd_public, unsigned int rd_public_count, struct DhtPutActivity *ma)
 Store GNS records in the DHT. More...
 
static void zone_iteration_error (void *cls)
 We encountered an error in our zone iteration. More...
 
static void zone_iteration_finished (void *cls)
 Zone iteration is completed. More...
 
static void put_gns_record (void *cls, const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, unsigned int rd_count, const struct GNUNET_GNSRECORD_Data *rd)
 Function used to put all records successively into the DHT. More...
 
static void run (void *cls, const struct GNUNET_CONFIGURATION_Handle *c, struct GNUNET_SERVICE_Handle *service)
 Performe zonemaster duties: watch namestore, publish records. More...
 
 GNUNET_SERVICE_MAIN ("zonemaster", GNUNET_SERVICE_OPTION_NONE, &run, NULL, NULL, NULL, GNUNET_MQ_handler_end())
 Define "main" method using service macro. More...
 

Variables

static struct GNUNET_STATISTICS_Handlestatistics
 Handle to the statistics service. More...
 
static struct GNUNET_DHT_Handledht_handle
 Our handle to the DHT. More...
 
static struct GNUNET_NAMESTORE_Handlenamestore_handle
 Our handle to the namestore service. More...
 
static struct GNUNET_NAMESTORE_ZoneIteratornamestore_iter
 Handle to iterate over our authoritative zone in namestore. More...
 
static struct DhtPutActivityit_head
 Head of iteration put activities; kept in a DLL. More...
 
static struct DhtPutActivityit_tail
 Tail of iteration put activities; kept in a DLL. More...
 
static unsigned int dht_queue_length
 Number of entries in the DHT queue it_head. More...
 
static unsigned long long num_public_records
 Useful for zone update for DHT put. More...
 
static unsigned long long last_num_public_records
 Last seen record count. More...
 
static unsigned long long put_cnt
 Number of successful put operations performed in the current measurement cycle (as measured in check_zone_namestore_next()). More...
 
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
 What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone. More...
 
static struct GNUNET_TIME_Relative min_relative_record_time
 Minimum relative expiration time of records seem during the current zone iteration. More...
 
static struct GNUNET_TIME_Relative last_min_relative_record_time
 Minimum relative expiration time of records seem during the last zone iteration. More...
 
static struct GNUNET_TIME_Relative zone_publish_time_window_default
 Default time window for zone iteration. More...
 
static struct GNUNET_TIME_Relative zone_publish_time_window
 Time window for zone iteration, adjusted based on relative record expiration times in our zone. More...
 
static struct GNUNET_TIME_Absolute last_put_100
 When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculations. More...
 
static struct GNUNET_TIME_Relative sub_delta
 By how much should we try to increase our per-record iteration speed (over the desired speed calculated directly from the #put_interval)? Basically this value corresponds to the per-record CPU time overhead we have. More...
 
static struct GNUNET_SCHEDULER_Taskzone_publish_task
 zone publish task More...
 
static unsigned int ns_iteration_left
 How many more values are left for the current query before we need to explicitly ask the namestore for more? More...
 
static int first_zone_iteration
 GNUNET_YES if zone has never been published before More...
 
static int cache_keys
 Optimize block insertion by caching map of private keys to public keys in memory? More...
 

Detailed Description

publish records from namestore to GNUnet name system

Author
Christian Grothoff

Definition in file gnunet-service-zonemaster.c.

Macro Definition Documentation

◆ LOG_STRERROR_FILE

#define LOG_STRERROR_FILE (   kind,
  syscall,
  filename 
)    GNUNET_log_from_strerror_file(kind, "util", syscall, filename)

Definition at line 34 of file gnunet-service-zonemaster.c.

◆ PUBLISH_OPS_PER_EXPIRATION

#define PUBLISH_OPS_PER_EXPIRATION   4

How often should we (re)publish each record before it expires?

Definition at line 41 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval().

◆ DELTA_INTERVAL

#define DELTA_INTERVAL   100

How often do we measure the delta between desired zone iteration speed and actual speed, and tell statistics service about it?

Definition at line 48 of file gnunet-service-zonemaster.c.

Referenced by put_gns_record().

◆ NS_BLOCK_SIZE

#define NS_BLOCK_SIZE   1000

How many records do we fetch in one shot from the namestore?

Definition at line 53 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), and publish_zone_namestore_next().

◆ DHT_QUEUE_LIMIT

#define DHT_QUEUE_LIMIT   2000

How many pending DHT operations do we allow at most?

Definition at line 58 of file gnunet-service-zonemaster.c.

Referenced by put_gns_record().

◆ NAMESTORE_QUEUE_LIMIT

#define NAMESTORE_QUEUE_LIMIT   50

How many events may the namestore give us before it has to wait for us to keep up?

Definition at line 64 of file gnunet-service-zonemaster.c.

◆ INITIAL_ZONE_ITERATION_INTERVAL

#define INITIAL_ZONE_ITERATION_INTERVAL   GNUNET_TIME_UNIT_MILLISECONDS

The initial interval in milliseconds btween puts in a zone iteration.

Definition at line 70 of file gnunet-service-zonemaster.c.

Referenced by run().

◆ MAXIMUM_ZONE_ITERATION_INTERVAL

#define MAXIMUM_ZONE_ITERATION_INTERVAL   GNUNET_TIME_relative_multiply(GNUNET_TIME_UNIT_MINUTES, 15)

The upper bound for the zone iteration interval (per record).

Definition at line 76 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and check_zone_namestore_next().

◆ LATE_ITERATION_SPEEDUP_FACTOR

#define LATE_ITERATION_SPEEDUP_FACTOR   2

The factor the current zone iteration interval is divided by for each additional new record.

Definition at line 82 of file gnunet-service-zonemaster.c.

Referenced by update_velocity().

◆ DHT_GNS_REPLICATION_LEVEL

#define DHT_GNS_REPLICATION_LEVEL   5

What replication level do we use for DHT PUT operations?

Definition at line 87 of file gnunet-service-zonemaster.c.

Referenced by perform_dht_put().

Function Documentation

◆ shutdown_task()

static void shutdown_task ( void *  cls)
static

Task run during shutdown.

Parameters
clsunused
tcunused

Definition at line 243 of file gnunet-service-zonemaster.c.

References dht_queue_length, GNUNET_CONTAINER_DLL_remove, GNUNET_DHT_disconnect(), GNUNET_DHT_put_cancel(), GNUNET_ERROR_TYPE_DEBUG, GNUNET_free, GNUNET_log, GNUNET_NAMESTORE_disconnect(), GNUNET_NAMESTORE_zone_iteration_stop(), GNUNET_NO, GNUNET_SCHEDULER_cancel(), GNUNET_STATISTICS_destroy(), and DhtPutActivity::ph.

Referenced by run().

244 {
245  struct DhtPutActivity *ma;
246 
247  (void)cls;
249  "Shutting down!\n");
250  while (NULL != (ma = it_head))
251  {
255  it_tail,
256  ma);
258  GNUNET_free(ma);
259  }
260  if (NULL != statistics)
261  {
263  GNUNET_NO);
264  statistics = NULL;
265  }
266  if (NULL != zone_publish_task)
267  {
269  zone_publish_task = NULL;
270  }
271  if (NULL != namestore_iter)
272  {
274  namestore_iter = NULL;
275  }
276  if (NULL != namestore_handle)
277  {
279  namestore_handle = NULL;
280  }
281  if (NULL != dht_handle)
282  {
284  dht_handle = NULL;
285  }
286 }
#define GNUNET_CONTAINER_DLL_remove(head, tail, element)
Remove an element from a DLL.
struct GNUNET_DHT_PutHandle * ph
Handle for the DHT PUT operation.
void GNUNET_DHT_put_cancel(struct GNUNET_DHT_PutHandle *ph)
Cancels a DHT PUT operation.
Definition: dht_api.c:1030
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
#define GNUNET_NO
Definition: gnunet_common.h:78
static struct DhtPutActivity * it_tail
Tail of iteration put activities; kept in a DLL.
void GNUNET_STATISTICS_destroy(struct GNUNET_STATISTICS_Handle *h, int sync_first)
Destroy a handle (free all state associated with it).
Handle for DHT PUT activity triggered from the namestore monitor.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
void GNUNET_NAMESTORE_disconnect(struct GNUNET_NAMESTORE_Handle *h)
Disconnect from the namestore service (and free associated resources).
void GNUNET_NAMESTORE_zone_iteration_stop(struct GNUNET_NAMESTORE_ZoneIterator *it)
Stops iteration and releases the namestore handle for further calls.
static struct DhtPutActivity * it_head
Head of iteration put activities; kept in a DLL.
static struct GNUNET_DHT_Handle * dht_handle
Our handle to the DHT.
void GNUNET_DHT_disconnect(struct GNUNET_DHT_Handle *handle)
Shutdown connection with the DHT service.
Definition: dht_api.c:913
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static struct GNUNET_NAMESTORE_Handle * namestore_handle
Our handle to the namestore service.
#define GNUNET_log(kind,...)
#define GNUNET_free(ptr)
Wrapper around free.
void * GNUNET_SCHEDULER_cancel(struct GNUNET_SCHEDULER_Task *task)
Cancel the task with the specified identifier.
Definition: scheduler.c:956
Here is the call graph for this function:
Here is the caller graph for this function:

◆ publish_zone_namestore_next()

static void publish_zone_namestore_next ( void *  cls)
static

Method called periodically that triggers iteration over authoritative records.

Parameters
clsNULL

Definition at line 295 of file gnunet-service-zonemaster.c.

References GNUNET_assert, GNUNET_NAMESTORE_zone_iterator_next(), NS_BLOCK_SIZE, ns_iteration_left, and publish_zone_dht_start().

Referenced by check_zone_namestore_next().

296 {
297  (void)cls;
298  zone_publish_task = NULL;
299  GNUNET_assert(NULL != namestore_iter);
303  NS_BLOCK_SIZE);
304 }
#define NS_BLOCK_SIZE
How many records do we fetch in one shot from the namestore?
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
void GNUNET_NAMESTORE_zone_iterator_next(struct GNUNET_NAMESTORE_ZoneIterator *it, uint64_t limit)
Calls the record processor specified in GNUNET_NAMESTORE_zone_iteration_start for the next record...
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
Here is the call graph for this function:
Here is the caller graph for this function:

◆ publish_zone_dht_start()

static void publish_zone_dht_start ( void *  cls)
static

Periodically iterate over our zone and store everything in dht.

Periodically iterate over all zones and store everything in DHT.

Parameters
clsNULL

Definition at line 786 of file gnunet-service-zonemaster.c.

References GNUNET_assert, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NAMESTORE_zone_iteration_start(), GNUNET_NO, GNUNET_STATISTICS_update(), ns_iteration_left, num_public_records, put_gns_record(), zone_iteration_error(), and zone_iteration_finished().

Referenced by publish_zone_namestore_next(), run(), zone_iteration_error(), and zone_iteration_finished().

787 {
788  (void)cls;
789  zone_publish_task = NULL;
791  "Full zone iterations launched",
792  1,
793  GNUNET_NO);
795  "Starting DHT zone update!\n");
796  /* start counting again */
797  num_public_records = 0;
798  GNUNET_assert(NULL == namestore_iter);
799  ns_iteration_left = 1;
802  NULL, /* All zones */
804  NULL,
806  NULL,
808  NULL);
809  GNUNET_assert(NULL != namestore_iter);
810 }
struct GNUNET_NAMESTORE_ZoneIterator * GNUNET_NAMESTORE_zone_iteration_start(struct GNUNET_NAMESTORE_Handle *h, const struct GNUNET_CRYPTO_EcdsaPrivateKey *zone, GNUNET_SCHEDULER_TaskCallback error_cb, void *error_cb_cls, GNUNET_NAMESTORE_RecordMonitor proc, void *proc_cls, GNUNET_SCHEDULER_TaskCallback finish_cb, void *finish_cb_cls)
Starts a new zone iteration (used to periodically PUT all of our records into our DHT)...
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
static void zone_iteration_error(void *cls)
We encountered an error in our zone iteration.
#define GNUNET_NO
Definition: gnunet_common.h:78
void GNUNET_STATISTICS_update(struct GNUNET_STATISTICS_Handle *handle, const char *name, int64_t delta, int make_persistent)
Set statistic value for the peer.
static unsigned long long num_public_records
Useful for zone update for DHT put.
static void put_gns_record(void *cls, const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, unsigned int rd_count, const struct GNUNET_GNSRECORD_Data *rd)
Function used to put all records successively into the DHT.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
static struct GNUNET_NAMESTORE_Handle * namestore_handle
Our handle to the namestore service.
#define GNUNET_log(kind,...)
static void zone_iteration_finished(void *cls)
Zone iteration is completed.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ calculate_put_interval()

static void calculate_put_interval ( )
static

Calculate target_iteration_velocity_per_record.

If no records are known (startup) or none present we can safely set the interval to the value for a single record

Definition at line 320 of file gnunet-service-zonemaster.c.

References GNUNET_ERROR_TYPE_BULK, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NO, GNUNET_STATISTICS_set(), GNUNET_TIME_relative_divide(), GNUNET_TIME_relative_min(), last_min_relative_record_time, last_num_public_records, MAXIMUM_ZONE_ITERATION_INTERVAL, min_relative_record_time, num_public_records, PUBLISH_OPS_PER_EXPIRATION, GNUNET_TIME_Relative::rel_value_us, target_iteration_velocity_per_record, zone_publish_time_window, and zone_publish_time_window_default.

Referenced by update_velocity(), and zone_iteration_finished().

321 {
322  if (0 == num_public_records)
323  {
331  "No records in namestore database.\n");
332  }
333  else
334  {
345  }
350  "Minimum relative record expiration (in μs)",
352  GNUNET_NO);
354  "Zone publication time window (in μs)",
356  GNUNET_NO);
358  "Target zone iteration velocity (μs)",
360  GNUNET_NO);
361 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
uint64_t rel_value_us
The actual value.
static unsigned long long last_num_public_records
Last seen record count.
static struct GNUNET_TIME_Relative zone_publish_time_window
Time window for zone iteration, adjusted based on relative record expiration times in our zone...
static struct GNUNET_TIME_Relative zone_publish_time_window_default
Default time window for zone iteration.
#define GNUNET_NO
Definition: gnunet_common.h:78
#define PUBLISH_OPS_PER_EXPIRATION
How often should we (re)publish each record before it expires?
static struct GNUNET_TIME_Relative last_min_relative_record_time
Minimum relative expiration time of records seem during the last zone iteration.
static unsigned long long num_public_records
Useful for zone update for DHT put.
#define MAXIMUM_ZONE_ITERATION_INTERVAL
The upper bound for the zone iteration interval (per record).
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Relative GNUNET_TIME_relative_min(struct GNUNET_TIME_Relative t1, struct GNUNET_TIME_Relative t2)
Return the minimum of two relative time values.
Definition: time.c:272
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
#define GNUNET_log(kind,...)
struct GNUNET_TIME_Relative GNUNET_TIME_relative_divide(struct GNUNET_TIME_Relative rel, unsigned long long factor)
Divide relative time by a given factor.
Definition: time.c:525
Here is the call graph for this function:
Here is the caller graph for this function:

◆ update_velocity()

static void update_velocity ( unsigned int  cnt)
static

Re-calculate our velocity and the desired velocity.

We have succeeded in making DELTA_INTERVAL puts, so now calculate the new desired delay between puts.

Parameters
cnthow many records were processed since the last call?

Definition at line 372 of file gnunet-service-zonemaster.c.

References calculate_put_interval(), dht_queue_length, first_zone_iteration, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NO, GNUNET_STATISTICS_set(), GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_absolute_get(), GNUNET_TIME_absolute_get_duration(), GNUNET_TIME_relative_add(), GNUNET_TIME_relative_subtract(), GNUNET_TIME_UNIT_ZERO, GNUNET_YES, last_num_public_records, last_put_100, LATE_ITERATION_SPEEDUP_FACTOR, num_public_records, GNUNET_TIME_Relative::rel_value_us, sub_delta, and target_iteration_velocity_per_record.

Referenced by check_zone_namestore_next(), and put_gns_record().

373 {
375  unsigned long long pct = 0;
376 
377  if (0 == cnt)
378  return;
379  /* How fast were we really? */
381  delta.rel_value_us /= cnt;
383 
384  /* calculate expected frequency */
387  {
389  "Last record count was lower than current record count. Reducing interval.\n");
392  }
394  "Desired global zone iteration interval is %s/record!\n",
396  GNUNET_YES));
397 
398  /* Tell statistics actual vs. desired speed */
400  "Current zone iteration velocity (μs/record)",
402  GNUNET_NO);
403  /* update "sub_delta" based on difference, taking
404  previous sub_delta into account! */
406  {
407  /* We were too fast, reduce sub_delta! */
408  struct GNUNET_TIME_Relative corr;
409 
411  delta);
413  {
414  /* Reduce sub_delta by corr */
416  corr);
417  }
418  else
419  {
420  /* We're doing fine with waiting the full time, this
421  should theoretically only happen if we run at
422  infinite speed. */
424  }
425  }
427  {
428  /* We were too slow, increase sub_delta! */
429  struct GNUNET_TIME_Relative corr;
430 
434  corr);
436  {
437  /* CPU overload detected, we cannot go at desired speed,
438  as this would mean using a negative delay. */
439  /* compute how much faster we would want to be for
440  the desired velocity */
442  pct = UINT64_MAX; /* desired speed is infinity ... */
443  else
444  pct = (sub_delta.rel_value_us -
448  }
449  }
451  "# size of the DHT queue (it)",
453  GNUNET_NO);
455  "% speed increase needed for target velocity",
456  pct,
457  GNUNET_NO);
459  "# records processed in current iteration",
461  GNUNET_NO);
462 }
uint64_t rel_value_us
The actual value.
static struct GNUNET_TIME_Relative delta
Definition: speedup.c:35
static unsigned long long last_num_public_records
Last seen record count.
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
#define GNUNET_NO
Definition: gnunet_common.h:78
static unsigned long long num_public_records
Useful for zone update for DHT put.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
#define LATE_ITERATION_SPEEDUP_FACTOR
The factor the current zone iteration interval is divided by for each additional new record...
static void calculate_put_interval()
Calculate target_iteration_velocity_per_record.
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:686
static struct GNUNET_TIME_Relative sub_delta
By how much should we try to increase our per-record iteration speed (over the desired speed calculat...
struct GNUNET_TIME_Relative GNUNET_TIME_relative_subtract(struct GNUNET_TIME_Relative a1, struct GNUNET_TIME_Relative a2)
Subtract relative timestamp from the other.
Definition: time.c:602
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
#define GNUNET_TIME_UNIT_ZERO
Relative time zero.
struct GNUNET_TIME_Relative GNUNET_TIME_relative_add(struct GNUNET_TIME_Relative a1, struct GNUNET_TIME_Relative a2)
Add relative times together.
Definition: time.c:577
struct GNUNET_TIME_Relative GNUNET_TIME_absolute_get_duration(struct GNUNET_TIME_Absolute whence)
Get the duration of an operation as the difference of the current time and the given start time "henc...
Definition: time.c:373
#define GNUNET_log(kind,...)
static struct GNUNET_TIME_Absolute last_put_100
When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculatio...
#define GNUNET_YES
Definition: gnunet_common.h:77
Time for relative time used by GNUnet, in microseconds.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ check_zone_namestore_next()

static void check_zone_namestore_next ( )
static

Check if the current zone iteration needs to be continued by calling publish_zone_namestore_next(), and if so with what delay.

Definition at line 470 of file gnunet-service-zonemaster.c.

References first_zone_iteration, GNUNET_assert, GNUNET_NO, GNUNET_SCHEDULER_add_delayed(), GNUNET_STATISTICS_set(), GNUNET_TIME_relative_min(), GNUNET_TIME_relative_multiply(), GNUNET_TIME_relative_subtract(), GNUNET_TIME_UNIT_ZERO, GNUNET_YES, MAXIMUM_ZONE_ITERATION_INTERVAL, NS_BLOCK_SIZE, ns_iteration_left, publish_zone_namestore_next(), put_cnt, GNUNET_TIME_Relative::rel_value_us, sub_delta, target_iteration_velocity_per_record, and update_velocity().

Referenced by put_gns_record().

471 {
473 
474  if (0 != ns_iteration_left)
475  return; /* current NAMESTORE iteration not yet done */
477  put_cnt = 0;
479  sub_delta);
480  /* We delay *once* per #NS_BLOCK_SIZE, so we need to multiply the
481  per-record delay calculated so far with the #NS_BLOCK_SIZE */
483  "Current artificial NAMESTORE delay (μs/record)",
485  GNUNET_NO);
487  NS_BLOCK_SIZE);
488  /* make sure we do not overshoot because of the #NS_BLOCK_SIZE factor */
490  delay);
491  /* no delays on first iteration */
497  NULL);
498 }
#define NS_BLOCK_SIZE
How many records do we fetch in one shot from the namestore?
uint64_t rel_value_us
The actual value.
static void update_velocity(unsigned int cnt)
Re-calculate our velocity and the desired velocity.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
static void publish_zone_namestore_next(void *cls)
Method called periodically that triggers iteration over authoritative records.
#define GNUNET_NO
Definition: gnunet_common.h:78
#define MAXIMUM_ZONE_ITERATION_INTERVAL
The upper bound for the zone iteration interval (per record).
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_delayed(struct GNUNET_TIME_Relative delay, GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run with a specified delay.
Definition: scheduler.c:1237
static struct GNUNET_TIME_Relative sub_delta
By how much should we try to increase our per-record iteration speed (over the desired speed calculat...
struct GNUNET_TIME_Relative GNUNET_TIME_relative_multiply(struct GNUNET_TIME_Relative rel, unsigned long long factor)
Multiply relative time by a given factor.
Definition: time.c:440
struct GNUNET_TIME_Relative GNUNET_TIME_relative_subtract(struct GNUNET_TIME_Relative a1, struct GNUNET_TIME_Relative a2)
Subtract relative timestamp from the other.
Definition: time.c:602
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Relative GNUNET_TIME_relative_min(struct GNUNET_TIME_Relative t1, struct GNUNET_TIME_Relative t2)
Return the minimum of two relative time values.
Definition: time.c:272
static struct GNUNET_TIME_Relative delay
When should dkg communication start?
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
#define GNUNET_TIME_UNIT_ZERO
Relative time zero.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
static unsigned long long put_cnt
Number of successful put operations performed in the current measurement cycle (as measured in check_...
#define GNUNET_YES
Definition: gnunet_common.h:77
Time for relative time used by GNUnet, in microseconds.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ dht_put_continuation()

static void dht_put_continuation ( void *  cls)
static

Continuation called from DHT once the PUT operation is done.

Parameters
clsa struct DhtPutActivity

Definition at line 507 of file gnunet-service-zonemaster.c.

References dht_queue_length, GNUNET_CONTAINER_DLL_remove, GNUNET_ERROR_TYPE_DEBUG, GNUNET_free, and GNUNET_log.

Referenced by perform_dht_put().

508 {
509  struct DhtPutActivity *ma = cls;
510 
512  "PUT complete\n");
515  it_tail,
516  ma);
517  GNUNET_free(ma);
518 }
#define GNUNET_CONTAINER_DLL_remove(head, tail, element)
Remove an element from a DLL.
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
static struct DhtPutActivity * it_tail
Tail of iteration put activities; kept in a DLL.
Handle for DHT PUT activity triggered from the namestore monitor.
static struct DhtPutActivity * it_head
Head of iteration put activities; kept in a DLL.
#define GNUNET_log(kind,...)
#define GNUNET_free(ptr)
Wrapper around free.
Here is the caller graph for this function:

◆ convert_records_for_export()

static unsigned int convert_records_for_export ( const struct GNUNET_GNSRECORD_Data rd,
unsigned int  rd_count,
struct GNUNET_GNSRECORD_Data rd_public 
)
static

Convert namestore records from the internal format to that suitable for publication (removes private records, converts to absolute expiration time).

Parameters
rdinput records
rd_countsize of the rd and rd_public arrays
rd_publicwhere to write the converted records
Returns
number of records written to rd_public

Definition at line 532 of file gnunet-service-zonemaster.c.

References GNUNET_TIME_Absolute::abs_value_us, GNUNET_GNSRECORD_RF_PRIVATE, GNUNET_GNSRECORD_RF_RELATIVE_EXPIRATION, GNUNET_MIN, GNUNET_TIME_absolute_get(), min_relative_record_time, and GNUNET_TIME_Relative::rel_value_us.

Referenced by put_gns_record().

535 {
536  struct GNUNET_TIME_Absolute now;
537  unsigned int rd_public_count;
538 
539  rd_public_count = 0;
540  now = GNUNET_TIME_absolute_get();
541  for (unsigned int i = 0; i < rd_count; i++)
542  {
543  if (0 != (rd[i].flags & GNUNET_GNSRECORD_RF_PRIVATE))
544  continue;
545  if ((0 == (rd[i].flags & GNUNET_GNSRECORD_RF_RELATIVE_EXPIRATION)) &&
546  (rd[i].expiration_time < now.abs_value_us))
547  continue; /* record already expired, skip it */
548  if (0 != (rd[i].flags & GNUNET_GNSRECORD_RF_RELATIVE_EXPIRATION))
549  {
550  /* GNUNET_GNSRECORD_block_create will convert to absolute time;
551  we just need to adjust our iteration frequency */
553  GNUNET_MIN(rd[i].expiration_time,
555  }
556  rd_public[rd_public_count++] = rd[i];
557  }
558  return rd_public_count;
559 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
uint64_t rel_value_us
The actual value.
#define GNUNET_MIN(a, b)
Definition: gnunet_common.h:80
This is a private record of this peer and it should thus not be handed out to other peers...
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
Time for absolute times used by GNUnet, in microseconds.
This flag is currently unused; former RF_PENDING flag.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ perform_dht_put()

static struct GNUNET_DHT_PutHandle* perform_dht_put ( const struct GNUNET_CRYPTO_EcdsaPrivateKey key,
const char *  label,
const struct GNUNET_GNSRECORD_Data rd_public,
unsigned int  rd_public_count,
struct DhtPutActivity ma 
)
static

Store GNS records in the DHT.

Parameters
keykey of the zone
labellabel to store under
rd_publicpublic record data
rd_public_countnumber of records in rd_public
mahandle for the put operation
Returns
DHT PUT handle, NULL on error

Definition at line 573 of file gnunet-service-zonemaster.c.

References cache_keys, DHT_GNS_REPLICATION_LEVEL, dht_put_continuation(), GNUNET_BLOCK_TYPE_GNS_NAMERECORD, GNUNET_break, GNUNET_DHT_put(), GNUNET_DHT_RO_DEMULTIPLEX_EVERYWHERE, GNUNET_ERROR_TYPE_DEBUG, GNUNET_free, GNUNET_GNSRECORD_block_create(), GNUNET_GNSRECORD_block_create2(), GNUNET_GNSRECORD_query_from_private_key(), GNUNET_GNSRECORD_record_get_expiration_time(), GNUNET_h2s(), GNUNET_log, GNUNET_NO, GNUNET_STATISTICS_update(), GNUNET_STRINGS_absolute_time_to_string(), num_public_records, GNUNET_GNSRECORD_Block::purpose, ret, and GNUNET_CRYPTO_EccSignaturePurpose::size.

Referenced by put_gns_record().

578 {
579  struct GNUNET_GNSRECORD_Block *block;
580  struct GNUNET_HashCode query;
582  size_t block_size;
583  struct GNUNET_DHT_PutHandle *ret;
584 
586  rd_public);
587  if (cache_keys)
588  block = GNUNET_GNSRECORD_block_create2(key,
589  expire,
590  label,
591  rd_public,
592  rd_public_count);
593  else
594  block = GNUNET_GNSRECORD_block_create(key,
595  expire,
596  label,
597  rd_public,
598  rd_public_count);
599  if (NULL == block)
600  {
601  GNUNET_break(0);
602  return NULL; /* whoops */
603  }
604  block_size = ntohl(block->purpose.size)
605  + sizeof(struct GNUNET_CRYPTO_EcdsaSignature)
606  + sizeof(struct GNUNET_CRYPTO_EcdsaPublicKey);
608  label,
609  &query);
611  "DHT put operations initiated",
612  1,
613  GNUNET_NO);
615  "Storing %u record(s) for label `%s' in DHT with expiration `%s' under key %s\n",
616  rd_public_count,
617  label,
619  GNUNET_h2s(&query));
622  &query,
626  block_size,
627  block,
628  expire,
630  ma);
631  GNUNET_free(block);
632  return ret;
633 }
static void dht_put_continuation(void *cls)
Continuation called from DHT once the PUT operation is done.
struct GNUNET_GNSRECORD_Block * GNUNET_GNSRECORD_block_create(const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, struct GNUNET_TIME_Absolute expire, const char *label, const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count)
Sign name and records.
static void expire(void *cls)
Expire a PooledConnection object.
struct GNUNET_GNSRECORD_Block * GNUNET_GNSRECORD_block_create2(const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, struct GNUNET_TIME_Absolute expire, const char *label, const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count)
Sign name and records, cache derived public key (also keeps the private key in static memory...
#define GNUNET_NO
Definition: gnunet_common.h:78
const char * GNUNET_h2s(const struct GNUNET_HashCode *hc)
Convert a hash value to a string (for printing debug messages).
Information we have in an encrypted block with record data (i.e.
void GNUNET_STATISTICS_update(struct GNUNET_STATISTICS_Handle *handle, const char *name, int64_t delta, int make_persistent)
Set statistic value for the peer.
static int ret
Final status code.
Definition: gnunet-arm.c:89
static unsigned long long num_public_records
Useful for zone update for DHT put.
#define GNUNET_break(cond)
Use this for internal assertion violations that are not fatal (can be handled) but should not occur...
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
void GNUNET_GNSRECORD_query_from_private_key(const struct GNUNET_CRYPTO_EcdsaPrivateKey *zone, const char *label, struct GNUNET_HashCode *query)
Calculate the DHT query for a given label in a given zone.
#define DHT_GNS_REPLICATION_LEVEL
What replication level do we use for DHT PUT operations?
an ECC signature using ECDSA
uint32_t size
How many bytes does this signature sign? (including this purpose header); in network byte order (!)...
Block for storing record data.
A 512-bit hashcode.
struct GNUNET_TIME_Absolute GNUNET_GNSRECORD_record_get_expiration_time(unsigned int rd_count, const struct GNUNET_GNSRECORD_Data *rd)
Returns the expiration time of the given block of records.
struct GNUNET_DHT_PutHandle * GNUNET_DHT_put(struct GNUNET_DHT_Handle *handle, const struct GNUNET_HashCode *key, uint32_t desired_replication_level, enum GNUNET_DHT_RouteOption options, enum GNUNET_BLOCK_Type type, size_t size, const void *data, struct GNUNET_TIME_Absolute exp, GNUNET_SCHEDULER_TaskCallback cont, void *cont_cls)
Perform a PUT operation storing data in the DHT.
Definition: dht_api.c:961
static struct GNUNET_DHT_Handle * dht_handle
Our handle to the DHT.
static int cache_keys
Optimize block insertion by caching map of private keys to public keys in memory? ...
Handle to a PUT request.
Definition: dht_api.c:43
Public ECC key (always for Curve25519) encoded in a format suitable for network transmission and ECDS...
#define GNUNET_log(kind,...)
Time for absolute times used by GNUnet, in microseconds.
const char * GNUNET_STRINGS_absolute_time_to_string(struct GNUNET_TIME_Absolute t)
Like asctime, except for GNUnet time.
Definition: strings.c:741
struct GNUNET_CRYPTO_EccSignaturePurpose purpose
Number of bytes signed; also specifies the number of bytes of encrypted data that follow...
Each peer along the way should look at &#39;enc&#39; (otherwise only the k-peers closest to the key should lo...
#define GNUNET_free(ptr)
Wrapper around free.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ zone_iteration_error()

static void zone_iteration_error ( void *  cls)
static

We encountered an error in our zone iteration.

Parameters
clsNULL

Definition at line 642 of file gnunet-service-zonemaster.c.

References GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_SCHEDULER_add_now(), GNUNET_SCHEDULER_cancel(), and publish_zone_dht_start().

Referenced by publish_zone_dht_start().

643 {
644  (void)cls;
646  "Got disconnected from namestore database, retrying.\n");
647  namestore_iter = NULL;
648  /* We end up here on error/disconnect/shutdown, so potentially
649  while a zone publish task or a DHT put is still running; hence
650  we need to cancel those. */
651  if (NULL != zone_publish_task)
652  {
654  zone_publish_task = NULL;
655  }
657  NULL);
658 }
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_now(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run as soon as possible.
Definition: scheduler.c:1264
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static void publish_zone_dht_start(void *cls)
Periodically iterate over our zone and store everything in dht.
#define GNUNET_log(kind,...)
void * GNUNET_SCHEDULER_cancel(struct GNUNET_SCHEDULER_Task *task)
Cancel the task with the specified identifier.
Definition: scheduler.c:956
Here is the call graph for this function:
Here is the caller graph for this function:

◆ zone_iteration_finished()

static void zone_iteration_finished ( void *  cls)
static

Zone iteration is completed.

Parameters
clsNULL

Definition at line 667 of file gnunet-service-zonemaster.c.

References calculate_put_interval(), first_zone_iteration, GNUNET_assert, GNUNET_ERROR_TYPE_DEBUG, GNUNET_log, GNUNET_NO, GNUNET_SCHEDULER_add_delayed(), GNUNET_SCHEDULER_add_now(), GNUNET_STATISTICS_set(), GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_UNIT_FOREVER_REL, GNUNET_YES, last_min_relative_record_time, last_num_public_records, min_relative_record_time, num_public_records, publish_zone_dht_start(), GNUNET_TIME_Relative::rel_value_us, and target_iteration_velocity_per_record.

Referenced by publish_zone_dht_start().

668 {
669  (void)cls;
670  /* we're done with one iteration, calculate when to do the next one */
671  namestore_iter = NULL;
676  /* reset for next iteration */
680  "Zone iteration finished. Adjusted zone iteration interval to %s\n",
682  GNUNET_YES));
684  "Target zone iteration velocity (μs)",
686  GNUNET_NO);
688  "Number of public records in DHT",
690  GNUNET_NO);
692  if (0 == last_num_public_records)
693  {
696  NULL);
697  }
698  else
699  {
701  NULL);
702  }
703 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
uint64_t rel_value_us
The actual value.
static unsigned long long last_num_public_records
Last seen record count.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
#define GNUNET_assert(cond)
Use this for fatal errors that cannot be handled.
#define GNUNET_NO
Definition: gnunet_common.h:78
static struct GNUNET_TIME_Relative last_min_relative_record_time
Minimum relative expiration time of records seem during the last zone iteration.
static unsigned long long num_public_records
Useful for zone update for DHT put.
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_delayed(struct GNUNET_TIME_Relative delay, GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run with a specified delay.
Definition: scheduler.c:1237
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_now(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run as soon as possible.
Definition: scheduler.c:1264
static void calculate_put_interval()
Calculate target_iteration_velocity_per_record.
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:686
#define GNUNET_TIME_UNIT_FOREVER_REL
Constant used to specify "forever".
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
static struct GNUNET_NAMESTORE_ZoneIterator * namestore_iter
Handle to iterate over our authoritative zone in namestore.
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static void publish_zone_dht_start(void *cls)
Periodically iterate over our zone and store everything in dht.
#define GNUNET_log(kind,...)
#define GNUNET_YES
Definition: gnunet_common.h:77
Here is the call graph for this function:
Here is the caller graph for this function:

◆ put_gns_record()

static void put_gns_record ( void *  cls,
const struct GNUNET_CRYPTO_EcdsaPrivateKey key,
const char *  label,
unsigned int  rd_count,
const struct GNUNET_GNSRECORD_Data rd 
)
static

Function used to put all records successively into the DHT.

Parameters
clsthe closure (NULL)
keythe private key of the authority (ours)
labelthe name of the records, NULL once the iteration is done
rd_countthe number of records in rd
rdthe record data

Definition at line 716 of file gnunet-service-zonemaster.c.

References check_zone_namestore_next(), convert_records_for_export(), DELTA_INTERVAL, dht_queue_length, DHT_QUEUE_LIMIT, GNUNET_CONTAINER_DLL_insert_tail, GNUNET_CONTAINER_DLL_remove, GNUNET_DHT_put_cancel(), GNUNET_ERROR_TYPE_DEBUG, GNUNET_ERROR_TYPE_WARNING, GNUNET_free, GNUNET_log, GNUNET_new, GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_absolute_get(), GNUNET_TIME_absolute_get_duration(), GNUNET_YES, it_head, ns_iteration_left, perform_dht_put(), DhtPutActivity::ph, put_cnt, DhtPutActivity::start_date, and update_velocity().

Referenced by publish_zone_dht_start().

721 {
722  struct GNUNET_GNSRECORD_Data rd_public[rd_count];
723  unsigned int rd_public_count;
724  struct DhtPutActivity *ma;
725 
726  (void)cls;
728  rd_public_count = convert_records_for_export(rd,
729  rd_count,
730  rd_public);
731  if (0 == rd_public_count)
732  {
734  "Record set empty, moving to next record set\n");
736  return;
737  }
738  /* We got a set of records to publish */
740  "Starting DHT PUT\n");
741  ma = GNUNET_new(struct DhtPutActivity);
743  ma->ph = perform_dht_put(key,
744  label,
745  rd_public,
746  rd_public_count,
747  ma);
748  put_cnt++;
749  if (0 == put_cnt % DELTA_INTERVAL)
750  update_velocity(DELTA_INTERVAL);
752  if (NULL == ma->ph)
753  {
755  "Could not perform DHT PUT, is the DHT running?\n");
756  GNUNET_free(ma);
757  return;
758  }
761  it_tail,
762  ma);
764  {
765  ma = it_head;
767  it_tail,
768  ma);
772  "DHT PUT unconfirmed after %s, aborting PUT\n",
774  GNUNET_YES));
775  GNUNET_free(ma);
776  }
777 }
#define GNUNET_CONTAINER_DLL_remove(head, tail, element)
Remove an element from a DLL.
struct GNUNET_DHT_PutHandle * ph
Handle for the DHT PUT operation.
void GNUNET_DHT_put_cancel(struct GNUNET_DHT_PutHandle *ph)
Cancels a DHT PUT operation.
Definition: dht_api.c:1030
static void update_velocity(unsigned int cnt)
Re-calculate our velocity and the desired velocity.
static unsigned int dht_queue_length
Number of entries in the DHT queue it_head.
#define DELTA_INTERVAL
How often do we measure the delta between desired zone iteration speed and actual speed...
static struct GNUNET_DHT_PutHandle * perform_dht_put(const struct GNUNET_CRYPTO_EcdsaPrivateKey *key, const char *label, const struct GNUNET_GNSRECORD_Data *rd_public, unsigned int rd_public_count, struct DhtPutActivity *ma)
Store GNS records in the DHT.
struct GNUNET_TIME_Absolute start_date
When was this PUT initiated?
#define GNUNET_new(type)
Allocate a struct or union of the given type.
static struct DhtPutActivity * it_tail
Tail of iteration put activities; kept in a DLL.
Handle for DHT PUT activity triggered from the namestore monitor.
static unsigned int convert_records_for_export(const struct GNUNET_GNSRECORD_Data *rd, unsigned int rd_count, struct GNUNET_GNSRECORD_Data *rd_public)
Convert namestore records from the internal format to that suitable for publication (removes private ...
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:686
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
#define DHT_QUEUE_LIMIT
How many pending DHT operations do we allow at most?
static struct DhtPutActivity * it_head
Head of iteration put activities; kept in a DLL.
#define GNUNET_CONTAINER_DLL_insert_tail(head, tail, element)
Insert an element at the tail of a DLL.
static void check_zone_namestore_next()
Check if the current zone iteration needs to be continued by calling publish_zone_namestore_next(), and if so with what delay.
static unsigned int ns_iteration_left
How many more values are left for the current query before we need to explicitly ask the namestore fo...
static unsigned long long put_cnt
Number of successful put operations performed in the current measurement cycle (as measured in check_...
struct GNUNET_TIME_Relative GNUNET_TIME_absolute_get_duration(struct GNUNET_TIME_Absolute whence)
Get the duration of an operation as the difference of the current time and the given start time "henc...
Definition: time.c:373
#define GNUNET_log(kind,...)
#define GNUNET_YES
Definition: gnunet_common.h:77
#define GNUNET_free(ptr)
Wrapper around free.
Here is the call graph for this function:
Here is the caller graph for this function:

◆ run()

static void run ( void *  cls,
const struct GNUNET_CONFIGURATION_Handle c,
struct GNUNET_SERVICE_Handle service 
)
static

Performe zonemaster duties: watch namestore, publish records.

Parameters
clsclosure
serverthe initialized server
cconfiguration to use

Definition at line 821 of file gnunet-service-zonemaster.c.

References _, cache_keys, first_zone_iteration, GNUNET_CONFIGURATION_get_value_number(), GNUNET_CONFIGURATION_get_value_time(), GNUNET_CONFIGURATION_get_value_yesno(), GNUNET_DHT_connect(), GNUNET_DHT_DEFAULT_REPUBLISH_FREQUENCY, GNUNET_ERROR_TYPE_DEBUG, GNUNET_ERROR_TYPE_ERROR, GNUNET_log, GNUNET_MQ_handler_end, GNUNET_NAMESTORE_connect(), GNUNET_NO, GNUNET_OK, GNUNET_SCHEDULER_add_now(), GNUNET_SCHEDULER_add_shutdown(), GNUNET_SCHEDULER_shutdown(), GNUNET_SERVICE_MAIN(), GNUNET_SERVICE_OPTION_NONE, GNUNET_STATISTICS_create(), GNUNET_STATISTICS_set(), GNUNET_STRINGS_relative_time_to_string(), GNUNET_TIME_absolute_get(), GNUNET_TIME_UNIT_FOREVER_REL, GNUNET_YES, INITIAL_ZONE_ITERATION_INTERVAL, last_put_100, min_relative_record_time, publish_zone_dht_start(), GNUNET_TIME_Relative::rel_value_us, shutdown_task(), target_iteration_velocity_per_record, zone_publish_time_window, and zone_publish_time_window_default.

824 {
825  unsigned long long max_parallel_bg_queries = 128;
826 
827  (void)cls;
828  (void)service;
829  last_put_100 = GNUNET_TIME_absolute_get(); /* first time! */
834  if (NULL == namestore_handle)
835  {
837  _("Failed to connect to the namestore!\n"));
839  return;
840  }
842  "namestore",
843  "CACHE_KEYS");
845  if (GNUNET_OK ==
847  "zonemaster",
848  "ZONE_PUBLISH_TIME_WINDOW",
850  {
852  "Time window for zone iteration: %s\n",
854  GNUNET_YES));
855  }
857  if (GNUNET_OK ==
859  "zonemaster",
860  "MAX_PARALLEL_BACKGROUND_QUERIES",
861  &max_parallel_bg_queries))
862  {
864  "Number of allowed parallel background queries: %llu\n",
865  max_parallel_bg_queries);
866  }
867  if (0 == max_parallel_bg_queries)
868  max_parallel_bg_queries = 1;
870  (unsigned int)max_parallel_bg_queries);
871  if (NULL == dht_handle)
872  {
874  _("Could not connect to DHT!\n"));
876  NULL);
877  return;
878  }
879 
880  /* Schedule periodic put for our records. */
882  statistics = GNUNET_STATISTICS_create("zonemaster",
883  c);
885  "Target zone iteration velocity (μs)",
887  GNUNET_NO);
889  NULL);
891  NULL);
892 }
static struct GNUNET_TIME_Relative min_relative_record_time
Minimum relative expiration time of records seem during the current zone iteration.
int GNUNET_CONFIGURATION_get_value_time(const struct GNUNET_CONFIGURATION_Handle *cfg, const char *section, const char *option, struct GNUNET_TIME_Relative *time)
Get a configuration value that should be a relative time.
int GNUNET_CONFIGURATION_get_value_number(const struct GNUNET_CONFIGURATION_Handle *cfg, const char *section, const char *option, unsigned long long *number)
Get a configuration value that should be a number.
uint64_t rel_value_us
The actual value.
static void shutdown_task(void *cls)
Task run during shutdown.
static int first_zone_iteration
GNUNET_YES if zone has never been published before
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_shutdown(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run on shutdown, that is when a CTRL-C signal is received, or when GNUNET_SCHEDULER_shutdown() is being invoked.
Definition: scheduler.c:1284
struct GNUNET_STATISTICS_Handle * GNUNET_STATISTICS_create(const char *subsystem, const struct GNUNET_CONFIGURATION_Handle *cfg)
Get handle for the statistics service.
static struct GNUNET_TIME_Relative zone_publish_time_window
Time window for zone iteration, adjusted based on relative record expiration times in our zone...
static struct GNUNET_TIME_Relative zone_publish_time_window_default
Default time window for zone iteration.
#define GNUNET_NO
Definition: gnunet_common.h:78
#define GNUNET_OK
Named constants for return values.
Definition: gnunet_common.h:75
void GNUNET_SCHEDULER_shutdown(void)
Request the shutdown of a scheduler.
Definition: scheduler.c:517
static struct GNUNET_STATISTICS_Handle * statistics
Handle to the statistics service.
#define _(String)
GNU gettext support macro.
Definition: platform.h:181
#define GNUNET_DHT_DEFAULT_REPUBLISH_FREQUENCY
Default republication frequency for stored data in the DHT.
struct GNUNET_SCHEDULER_Task * GNUNET_SCHEDULER_add_now(GNUNET_SCHEDULER_TaskCallback task, void *task_cls)
Schedule a new task to be run as soon as possible.
Definition: scheduler.c:1264
#define INITIAL_ZONE_ITERATION_INTERVAL
The initial interval in milliseconds btween puts in a zone iteration.
const char * GNUNET_STRINGS_relative_time_to_string(struct GNUNET_TIME_Relative delta, int do_round)
Give relative time in human-readable fancy format.
Definition: strings.c:686
#define GNUNET_TIME_UNIT_FOREVER_REL
Constant used to specify "forever".
void GNUNET_STATISTICS_set(struct GNUNET_STATISTICS_Handle *handle, const char *name, uint64_t value, int make_persistent)
Set statistic value for the peer.
struct GNUNET_TIME_Absolute GNUNET_TIME_absolute_get(void)
Get the current time.
Definition: time.c:118
struct GNUNET_DHT_Handle * GNUNET_DHT_connect(const struct GNUNET_CONFIGURATION_Handle *cfg, unsigned int ht_len)
Initialize the connection with the DHT service.
Definition: dht_api.c:885
static struct GNUNET_DHT_Handle * dht_handle
Our handle to the DHT.
struct GNUNET_NAMESTORE_Handle * GNUNET_NAMESTORE_connect(const struct GNUNET_CONFIGURATION_Handle *cfg)
Connect to the namestore service.
static struct GNUNET_TIME_Relative target_iteration_velocity_per_record
What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.
static struct GNUNET_SCHEDULER_Task * zone_publish_task
zone publish task
static void publish_zone_dht_start(void *cls)
Periodically iterate over our zone and store everything in dht.
static int cache_keys
Optimize block insertion by caching map of private keys to public keys in memory? ...
static struct GNUNET_NAMESTORE_Handle * namestore_handle
Our handle to the namestore service.
#define GNUNET_log(kind,...)
static struct GNUNET_TIME_Absolute last_put_100
When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculatio...
#define GNUNET_YES
Definition: gnunet_common.h:77
int GNUNET_CONFIGURATION_get_value_yesno(const struct GNUNET_CONFIGURATION_Handle *cfg, const char *section, const char *option)
Get a configuration value that should be in a set of "YES" or "NO".
Here is the call graph for this function:

◆ GNUNET_SERVICE_MAIN()

GNUNET_SERVICE_MAIN ( "zonemaster"  ,
GNUNET_SERVICE_OPTION_NONE  ,
run,
NULL  ,
NULL  ,
NULL  ,
GNUNET_MQ_handler_end()   
)

Define "main" method using service macro.

Referenced by run().

Here is the caller graph for this function:

Variable Documentation

◆ statistics

struct GNUNET_STATISTICS_Handle* statistics
static

Handle to the statistics service.

Definition at line 119 of file gnunet-service-zonemaster.c.

◆ dht_handle

struct GNUNET_DHT_Handle* dht_handle
static

Our handle to the DHT.

Definition at line 124 of file gnunet-service-zonemaster.c.

◆ namestore_handle

struct GNUNET_NAMESTORE_Handle* namestore_handle
static

Our handle to the namestore service.

Definition at line 129 of file gnunet-service-zonemaster.c.

◆ namestore_iter

struct GNUNET_NAMESTORE_ZoneIterator* namestore_iter
static

Handle to iterate over our authoritative zone in namestore.

Definition at line 134 of file gnunet-service-zonemaster.c.

◆ it_head

struct DhtPutActivity* it_head
static

Head of iteration put activities; kept in a DLL.

Definition at line 139 of file gnunet-service-zonemaster.c.

Referenced by put_gns_record().

◆ it_tail

struct DhtPutActivity* it_tail
static

Tail of iteration put activities; kept in a DLL.

Definition at line 144 of file gnunet-service-zonemaster.c.

◆ dht_queue_length

unsigned int dht_queue_length
static

Number of entries in the DHT queue it_head.

Definition at line 149 of file gnunet-service-zonemaster.c.

Referenced by dht_put_continuation(), put_gns_record(), shutdown_task(), and update_velocity().

◆ num_public_records

unsigned long long num_public_records
static

Useful for zone update for DHT put.

Definition at line 154 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), perform_dht_put(), publish_zone_dht_start(), update_velocity(), and zone_iteration_finished().

◆ last_num_public_records

unsigned long long last_num_public_records
static

Last seen record count.

Definition at line 159 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), update_velocity(), and zone_iteration_finished().

◆ put_cnt

unsigned long long put_cnt
static

Number of successful put operations performed in the current measurement cycle (as measured in check_zone_namestore_next()).

Definition at line 165 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), and put_gns_record().

◆ target_iteration_velocity_per_record

struct GNUNET_TIME_Relative target_iteration_velocity_per_record
static

What is the frequency at which we currently would like to perform DHT puts (per record)? Calculated in update_velocity() from the zone_publish_time_window() and the total number of record sets we have (so far) observed in the zone.

Definition at line 174 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), check_zone_namestore_next(), run(), update_velocity(), and zone_iteration_finished().

◆ min_relative_record_time

struct GNUNET_TIME_Relative min_relative_record_time
static

Minimum relative expiration time of records seem during the current zone iteration.

Definition at line 180 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), convert_records_for_export(), run(), and zone_iteration_finished().

◆ last_min_relative_record_time

struct GNUNET_TIME_Relative last_min_relative_record_time
static

Minimum relative expiration time of records seem during the last zone iteration.

Definition at line 186 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and zone_iteration_finished().

◆ zone_publish_time_window_default

struct GNUNET_TIME_Relative zone_publish_time_window_default
static

Default time window for zone iteration.

Definition at line 191 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and run().

◆ zone_publish_time_window

struct GNUNET_TIME_Relative zone_publish_time_window
static

Time window for zone iteration, adjusted based on relative record expiration times in our zone.

Definition at line 197 of file gnunet-service-zonemaster.c.

Referenced by calculate_put_interval(), and run().

◆ last_put_100

struct GNUNET_TIME_Absolute last_put_100
static

When did we last start measuring the DELTA_INTERVAL successful DHT puts? Used for velocity calculations.

Definition at line 203 of file gnunet-service-zonemaster.c.

Referenced by run(), and update_velocity().

◆ sub_delta

struct GNUNET_TIME_Relative sub_delta
static

By how much should we try to increase our per-record iteration speed (over the desired speed calculated directly from the #put_interval)? Basically this value corresponds to the per-record CPU time overhead we have.

Definition at line 211 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), and update_velocity().

◆ zone_publish_task

struct GNUNET_SCHEDULER_Task* zone_publish_task
static

zone publish task

Definition at line 216 of file gnunet-service-zonemaster.c.

◆ ns_iteration_left

unsigned int ns_iteration_left
static

How many more values are left for the current query before we need to explicitly ask the namestore for more?

Definition at line 222 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), publish_zone_dht_start(), publish_zone_namestore_next(), and put_gns_record().

◆ first_zone_iteration

int first_zone_iteration
static

GNUNET_YES if zone has never been published before

Definition at line 227 of file gnunet-service-zonemaster.c.

Referenced by check_zone_namestore_next(), run(), update_velocity(), and zone_iteration_finished().

◆ cache_keys

int cache_keys
static

Optimize block insertion by caching map of private keys to public keys in memory?

Definition at line 233 of file gnunet-service-zonemaster.c.

Referenced by perform_dht_put(), and run().