Human Generated Data

Title

Untitled (group portrait posed in front of painted backdrop in an outdoor setting)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13024

Human Generated Data

Title

Untitled (group portrait posed in front of painted backdrop in an outdoor setting)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Human 99.5
Person 99.5
Person 98.9
Person 98.7
Person 98.4
People 98.4
Person 97.9
Person 97.7
Person 96.9
Family 90.4
Military Uniform 89.7
Military 89.7
Apparel 81.9
Clothing 81.9
Troop 75.5
Army 75.5
Armored 75.5
Soldier 75.2
Footwear 75
Shoe 75
Shoe 67.8
Furniture 65.2
Chair 65.2
Officer 63.2

Imagga
created on 2022-01-24

kin 100
man 35.6
male 29
military uniform 26.7
people 23.4
uniform 22.4
adult 22.2
person 21.1
couple 20.9
attractive 18.9
clothing 17.7
portrait 16.8
love 16.6
home 15.9
happy 15.7
family 15.1
happiness 14.9
sitting 14.6
couch 14.5
room 13.3
sexy 12.8
suit 12.8
black 12.6
lady 12.2
dress 11.7
vintage 11.6
together 11.4
pretty 11.2
old 11.1
casual 11
covering 10.9
consumer goods 10.9
handsome 10.7
antique 10.4
men 10.3
mother 10.1
smiling 10.1
smile 10
chair 9.9
human 9.7
interior 9.7
husband 9.7
looking 9.6
elegant 9.4
work 9.4
lifestyle 9.4
indoor 9.1
business 9.1
romantic 8.9
job 8.8
father 8.6
model 8.5
art 8.5
face 8.5
child 8.4
relationship 8.4
fashion 8.3
one 8.2
romance 8
worker 8
married 7.7
two 7.6
wife 7.6
passion 7.5
senior 7.5
cheerful 7.3
office 7.2
professional 7.2
religion 7.2
women 7.1
posing 7.1

Google
created on 2022-01-24

Footwear 98.4
Shoe 95.1
Coat 91.2
Hat 83.9
Military person 80.6
Chair 80
Suit 76.5
Classic 72.9
Vintage clothing 72.6
Military officer 70.5
Crew 69.4
Event 67.5
Uniform 67.5
Boot 67
Military uniform 64
History 64
Sun hat 63
Stock photography 62.9
Sitting 60.3
Soldier 59.6

Microsoft
created on 2022-01-24

person 99.9
clothing 98.8
old 96.8
grass 95.3
man 93.4
posing 92.4
outdoor 92.2
text 90.2
smile 81.5
group 78.7
black 68.3
vintage 38.5
team 35.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Male, 57.4%
Calm 99.9%
Sad 0%
Confused 0%
Surprised 0%
Angry 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 98.9%
Confused 0.5%
Surprised 0.2%
Angry 0.2%
Sad 0.1%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 99.9%
Calm 99.6%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Sad 0%
Surprised 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.6%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 98.4%
Sad 0.5%
Surprised 0.4%
Confused 0.4%
Fear 0.2%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 13-21
Gender Male, 90.3%
Calm 83.2%
Angry 7.6%
Sad 5.6%
Confused 2%
Surprised 0.8%
Fear 0.4%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Male, 97.2%
Calm 79.8%
Angry 8.9%
Sad 4.7%
Confused 3.7%
Fear 1.1%
Surprised 0.9%
Disgusted 0.6%
Happy 0.5%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 75%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.8%
a vintage photo of a group of people sitting posing for the camera 97.3%
a vintage photo of a group of people posing for a picture 97.2%