Human Generated Data

Title

Untitled (a Toda family)
Date

c. 1860-1880
People

Artist: Willoughby Wallace Hooper, British 1837 - 1912
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.64

Human Generated Data

Title

Untitled (a Toda family)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.64

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 98.1
Human 98.1
Art 97.2
Painting 97.2
Person 96.2
Person 96
Clothing 83.1
Apparel 83.1
Face 77.2
People 69
Female 68.7
Photography 64.7
Photo 64.7
Portrait 61.8
Girl 58.7
Drawing 58.1
Sitting 56.1

Clarifai
created on 2018-10-18

people 99.9
adult 98.8
two 98.6
portrait 96.8
wear 96.5
man 95.6
one 94.5
woman 93
group 90.3
leader 90.1
three 90.1
war 89.8
retro 89.3
art 89
music 85.2
military 84.8
soldier 84.7
sit 84.1
facial expression 83.4
veil 82.7

Imagga
created on 2018-10-18

sketch 100
drawing 100
representation 86.3
statue 32.2
sculpture 28.8
art 22.2
ancient 20.8
religion 19.7
portrait 19.4
dress 18.1
old 17.4
attractive 16.8
religious 15.9
person 15.8
antique 15.6
model 15.6
face 14.9
architecture 14.8
sexy 14.5
fashion 14.3
adult 14.3
hair 14.3
people 13.9
culture 13.7
monument 13.1
decoration 13.1
lady 13
stone 12.7
pretty 12.6
history 11.6
detail 11.3
building 11.1
historic 11
cute 10.8
bride 10.6
god 10.5
style 10.4
historical 10.4
famous 10.2
head 10.1
girls 10
figure 10
vintage 9.9
catholic 9.7
marble 9.7
love 9.5
church 9.3
elegance 9.2
wedding 9.2
travel 9.2
traditional 9.1
city 9.1
romantic 8.9
females 8.5
decorative 8.4
gorgeous 8.2
man 8.1
posing 8
brunette 7.8
couple 7.8
happiness 7.8
holy 7.7
spiritual 7.7
faith 7.7
happy 7.5
one 7.5
design 7.5
tourism 7.4
symbol 7.4
sensuality 7.3
body 7.2
celebration 7.2
women 7.1

Google
created on 2018-10-18

photograph 94.8
sitting 73.7
human behavior 68.8
vintage clothing 65.3
art 55.2
stock photography 52.3
black and white 51.6
sand 50.6

Microsoft
created on 2018-10-18

person 97.3
outdoor 97.1
old 77.7
posing 41.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 94%
Confused 2.7%
Angry 9.4%
Disgusted 2.2%
Calm 6.8%
Happy 0.9%
Surprised 1.3%
Sad 76.6%

AWS Rekognition

Age 35-52
Gender Male, 81.1%
Angry 1.5%
Calm 92.6%
Confused 0.7%
Disgusted 2.8%
Surprised 1.5%
Happy 0.5%
Sad 0.5%

AWS Rekognition

Age 20-38
Gender Female, 52.7%
Disgusted 2%
Calm 2%
Surprised 1.2%
Angry 78.2%
Happy 1.2%
Sad 14.1%
Confused 1.3%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Painting 97.2%

Categories

Imagga

paintings art 99.3%
interior objects 0.4%
pets animals 0.2%

Captions

Microsoft
created on 2018-10-18

a vintage photo of a person 91.1%
a group of people sitting around a baseball field 62.5%
a vintage photo of a baseball player holding a bat 46.1%

Anthropic Claude

Created on 2024-11-21

The image shows three individuals sitting on the ground in an outdoor setting. The man in the center has a long beard and is wearing a blanket-like garment. The two individuals on either side of him appear to be children, one of which has long, wavy hair. They are all wrapped in blankets or other garments. The setting seems to be a grassy area, possibly in a rural or remote location.