Human Generated Data

Title

Recreation, Outings: Belgium. Antwerp. "Diesterweg," Vacation School Colony: Schoolkolonies van 1903 [School Colonies from 1903]
Date

1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.14.1

Human Generated Data

Title

Recreation, Outings: Belgium. Antwerp. "Diesterweg," Vacation School Colony: Schoolkolonies van 1903 [School Colonies from 1903]

People

Artist: Unidentified Artist,

Date

1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Apparel 99.8
Clothing 99.8
Overcoat 99.7
Coat 99.7
Human 97.9
Person 97.9
Tuxedo 97.6
Person 96.5
Person 95.8
Person 95.4
Person 95.2
Person 94.9
Person 93.2
Person 90.3
Suit 89.5
People 85.5
Footwear 82
Shoe 82
Suit 79.5
Suit 77.1
Blazer 73.4
Jacket 73.4
Suit 73
Suit 69.2
Family 68.5
Furniture 65.5
Suit 57.6
Shoe 53.8
Suit 50.3

Clarifai
created on 2019-06-05

people 99.9
leader 99.2
administration 98.9
group 98.9
group together 98.5
adult 98.5
chair 95.3
portrait 94.6
man 94.3
wear 94
many 92.9
woman 91.3
military 89.3
five 87.1
several 86.9
outfit 86.7
four 80.9
war 79.5
home 78.1
uniform 77.5

Imagga
created on 2019-06-05

businessman 48.5
business 43.1
man 41.6
male 35.4
corporate 35.2
people 31.8
person 30.3
suit 30.1
executive 29.4
office 28.9
group 27.4
team 26.9
men 25.7
businesspeople 24.7
businesswoman 23.6
colleagues 23.3
professional 21.9
businessmen 21.4
happy 21.3
adult 21
meeting 20.7
handsome 20.5
smiling 20.2
teamwork 18.5
success 18.5
job 17.7
confident 17.3
smile 17.1
work 16.5
corporation 16.4
manager 15.8
staff 15.7
standing 15.6
portrait 15.5
career 15.1
company 14.9
cheerful 13.8
associates 13.8
20s 13.7
tie 13.3
successful 12.8
secretary 12.7
happiness 12.5
partnership 12.5
boss 12.4
kin 12.4
mature 12.1
women 11.9
coworkers 11.8
40s 11.7
30s 11.5
couple 11.3
modern 11.2
attractive 11.2
partners 10.7
indoors 10.5
senior 10.3
casual 10.2
clothing 9.9
student 9.8
businesswomen 9.8
discussion 9.7
together 9.6
employee 9.6
looking 9.6
lifestyle 9.4
communication 9.2
jacket 9.2
worker 8.9
working 8.8
building 8.8
diversity 8.6
elegant 8.6
face 8.5
adults 8.5
indoor 8.2
black 8.2
computer 8
business people 7.9
discussing 7.9
life 7.7
sitting 7.7
busy 7.7
finance 7.6
desk 7.6
presentation 7.4
laptop 7.4
camera 7.4
occupation 7.3
planner 7.3
day 7.1

Google
created on 2019-06-05

Photograph 96.2
Family 63.8
Gentleman 57.3

Microsoft
created on 2019-06-05

person 99.6
clothing 98.9
man 97.4
group 94.3
smile 94
posing 85.2
people 83.3
suit 75.5
old 58.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 54.1%
Angry 45.3%
Confused 45.2%
Calm 54%
Surprised 45.1%
Sad 45.3%
Happy 45.1%
Disgusted 45%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Confused 45%
Surprised 45%
Angry 45.1%
Calm 45%
Sad 45%
Happy 45%
Disgusted 54.9%

AWS Rekognition

Age 35-52
Gender Male, 52.6%
Angry 46%
Sad 46%
Happy 45.2%
Disgusted 49.1%
Calm 48.2%
Surprised 45.2%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Confused 45.1%
Sad 54.1%
Happy 45.1%
Surprised 45%
Disgusted 45.1%
Calm 45.3%
Angry 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Surprised 45.3%
Confused 45.4%
Angry 45.6%
Happy 49.7%
Disgusted 45.4%
Sad 46%
Calm 47.7%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Confused 45.5%
Calm 45.8%
Angry 45.6%
Surprised 45.7%
Sad 46.9%
Happy 49.5%
Disgusted 46.1%

AWS Rekognition

Age 15-25
Gender Female, 54.1%
Calm 45.1%
Disgusted 45.1%
Sad 54.1%
Happy 45%
Confused 45%
Surprised 45%
Angry 45.6%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Disgusted 45.1%
Confused 45.5%
Calm 51.2%
Angry 45.9%
Happy 46.1%
Sad 45.7%
Surprised 45.5%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Suit 89.5%
Shoe 82%

Captions

Microsoft

Princess Sophie of Schönburg-Waldenburg et al. posing for a photo 98.7%
Princess Sophie of Schönburg-Waldenburg et al. posing for the camera 98.6%
Princess Sophie of Schönburg-Waldenburg et al. sitting posing for the camera 98.5%