Human Generated Data

Title

Untitled (horizontal portrait of group posed behind faux staircase and in front of painted backdrop of doorway)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13078

Human Generated Data

Title

Untitled (horizontal portrait of group posed behind faux staircase and in front of painted backdrop of doorway)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Person 99.5
Human 99.5
Person 99.5
Person 99.2
Person 99.1
Person 98.9
Person 98.8
Person 97.4
Person 96.5
People 94.2
Apparel 87.5
Clothing 87.5
Family 79.4
Military Uniform 75.8
Military 75.8
Officer 68.8
Banister 63.5
Handrail 63.5
Shorts 62.9
Porch 57.6
Archaeology 57.5
Army 57.4
Armored 57.4
Soldier 56.2
Jury 55.7

Imagga
created on 2022-01-24

kin 100
sculpture 25.1
statue 24.9
religion 23.3
art 22.2
old 20.9
ancient 19.9
antique 17.3
stone 17
history 16.1
man 15.5
people 14.5
vintage 14.1
architecture 14.1
historic 13.8
god 13.4
religious 13.1
monument 13.1
culture 12.8
grunge 12.8
person 12.3
decoration 11.9
currency 11.7
spirituality 11.5
face 11.4
historical 11.3
dollar 11.1
money 11.1
portrait 11
carving 10.8
sepia 10.7
marble 10.7
one 10.5
church 10.2
cash 10.1
male 9.9
business 9.7
world 9.3
travel 9.2
figure 9.1
detail 8.9
symbol 8.8
temple 8.5
finance 8.4
dark 8.4
tourism 8.3
closeup 8.1
bank 8.1
grave 7.9
golden 7.7
death 7.7
bill 7.6
head 7.6
sign 7.5
design 7.4
dirty 7.2
paper 7.1

Google
created on 2022-01-24

Microsoft
created on 2022-01-24

text 97.6
clothing 96.1
person 93.5
man 73.5
posing 69.2
old 61.5
human face 55.2
store 46.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 61.7%
Calm 99.1%
Confused 0.3%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 80.1%
Sad 18.3%
Confused 0.9%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 97.6%
Confused 1.4%
Sad 0.5%
Angry 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 33-41
Gender Female, 99.9%
Calm 97.4%
Confused 0.8%
Happy 0.7%
Sad 0.3%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 99.7%
Calm 99.9%
Confused 0%
Angry 0%
Surprised 0%
Fear 0%
Sad 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 99.9%
Calm 99.8%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 99.9%
Sad 0%
Angry 0%
Happy 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Female, 99.8%
Calm 96.7%
Confused 1%
Angry 0.7%
Sad 0.5%
Surprised 0.3%
Disgusted 0.3%
Fear 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 95.2%
a group of people posing for a photo in front of a building 94.8%
a group of people posing for a photo in front of a store 88.9%

Text analysis

Google

EXIS
EXIS