Human Generated Data

Title

Untitled (bride and groom at wedding)

Date

c. 1950

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18992

Human Generated Data

Title

Untitled (bride and groom at wedding)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.7
Human 99.7
Person 99.2
Apparel 98.1
Clothing 98.1
Person 98
Person 97.5
Person 97.3
Person 95.6
Coat 89.4
Overcoat 89.4
Suit 88.6
People 83
Face 67
Female 59.7
Tuxedo 59
Dress 56.9

Imagga
created on 2022-03-05

kin 68.2
senior 48.7
man 41
grandma 35.5
couple 34.8
male 34.7
happy 34.4
people 34
elderly 33.5
mature 26.9
person 26.7
love 26
retired 25.2
old 24.4
smile 23.5
smiling 23.1
retirement 22.1
portrait 22
home 20.7
husband 20.2
wife 19.9
adult 19.7
together 19.3
grandfather 17.8
family 17.8
grandmother 17.6
indoors 16.7
men 16.3
two 15.2
hair 15
mother 13.9
affection 13.5
gray 13.5
women 13.4
happiness 13.3
sibling 12.8
70s 12.8
married 12.5
lady 12.2
face 12.1
fun 12
health 11.8
lifestyle 11.6
care 11.5
loving 11.4
sitting 11.2
60s 10.7
romance 10.7
handsome 10.7
older 10.7
groom 10.6
cheerful 10.6
marriage 10.4
glasses 10.2
blond 10.2
pensioner 10
aged 9.9
seniors 9.8
medical 9.7
enjoying 9.5
room 9.3
drink 9.2
indoor 9.1
human 9
bow tie 8.8
looking 8.8
look 8.8
holiday 8.6
age 8.6
father 8.5
expression 8.5
laughing 8.5
pair 8.5
meeting 8.5
shower cap 8.4
joy 8.3
camera 8.3
holding 8.2
child 8.2
group 8.1
businessman 7.9
executive 7.7
affectionate 7.7
corporate 7.7
bride 7.7
casual 7.6
illness 7.6
active 7.4
wedding 7.4
business 7.3
clothing 7.3
office 7.2
necktie 7.2
celebration 7.2
daughter 7.1
to 7.1
day 7.1

Google
created on 2022-03-05

Black-and-white 85.9
Coat 85.4
Style 84
Monochrome 77.5
Monochrome photography 76.5
Vintage clothing 73.5
Suit 73.3
Curtain 72.5
Event 72.2
Room 71.7
Font 67.2
Art 65.8
Photo caption 64.9
Team 64.7
History 63.4
Classic 63.3
Stock photography 62.9
Sitting 59.9
Crew 56.7
Hat 56.4

Microsoft
created on 2022-03-05

person 99.4
musical instrument 88.7
standing 87.1
clothing 85.9
text 76.7
posing 73.9
human face 71
man 70.7
guitar 70.3
group 65
smile 59.9
black and white 58.2
people 58

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 65.7%
Happy 89.4%
Surprised 5.8%
Calm 2.6%
Sad 0.9%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 14-22
Gender Male, 90.7%
Happy 38.3%
Confused 24.7%
Surprised 19%
Sad 6.1%
Calm 5%
Disgusted 3.7%
Angry 1.8%
Fear 1.4%

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Happy 82.4%
Calm 6.4%
Surprised 4.3%
Sad 1.9%
Disgusted 1.8%
Confused 1.5%
Angry 1.2%
Fear 0.6%

AWS Rekognition

Age 2-10
Gender Male, 83.5%
Calm 100%
Sad 0%
Happy 0%
Disgusted 0%
Surprised 0%
Confused 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Suit 88.6%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of people posing for the camera 97.7%
a group of people posing for a picture 97.6%

Text analysis

Amazon

3
85
92
28 3 92
28
MJ17--YT37A°--X

Google

MJI7-- YT37A°2 --XAGOX 85
--XAGOX
YT37A°2
85
MJI7--