Human Generated Data

Title

Untitled (portrait of couple with woman in black wearing rose corsage and man with glasses and moustache)
Date

1935
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9076

Human Generated Data

Title

Untitled (portrait of couple with woman in black wearing rose corsage and man with glasses and moustache)

People

Artist: Martin Schweig, American 20th century

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.4
Person 99.4
Clothing 98.9
Apparel 98.9
Person 98.6
Face 97
Furniture 85.6
Chair 85.6
Photography 72.3
Portrait 72.3
Photo 72.3
Female 71
Outdoors 63.5
People 61.7
Door 61.6
Plant 60
Nature 59.7
Shirt 59.4
Sitting 58.6
Floor 57.3
Art 56.3

Imagga
created on 2022-01-23

lab coat 46.1
coat 38.7
man 32.9
male 32
people 31.8
person 30.4
adult 30.1
clothing 30.1
garment 22.5
couple 20.9
happy 20.7
businessman 20.3
patient 20.2
men 18.9
business 18.2
nurse 17.9
indoors 17.6
medical 16.8
home 16.7
groom 16.3
portrait 16.2
professional 15.9
day 15.7
happiness 15.7
smiling 15.2
senior 15
clothes 15
bride 14.8
looking 14.4
sitting 13.7
worker 13.7
casual 13.6
30s 13.5
women 13.4
businesspeople 13.3
job 13.3
occupation 12.8
20s 12.8
two 12.7
old 12.5
mature 12.1
indoor 11.9
room 11.8
40s 11.7
family 11.6
human 11.2
love 11
inside 11
wedding 11
handsome 10.7
colleagues 10.7
hospital 10.7
face 10.7
together 10.5
office 10.4
health 10.4
adults 10.4
doctor 10.3
corporate 10.3
mother 10.2
bright 10
businesswoman 10
smile 10
husband 9.8
fashion 9.8
cheerful 9.8
mid adult 9.6
wife 9.5
color 9.5
suit 9.4
negative 9.3
focus 9.3
window 9.2
alone 9.1
modern 9.1
attractive 9.1
dress 9
lady 8.9
businessmen 8.8
lab 8.7
ceremony 8.7
laboratory 8.7
work 8.6
elderly 8.6
serious 8.6
illness 8.6
marriage 8.5
black 8.4
ruler 8.4
horizontal 8.4
film 8.3
team 8.1
computer 8
life 8
working 8
medicine 7.9
business people 7.9
associates 7.9
forties 7.8
scientist 7.8
days 7.8
chemistry 7.7
concentration 7.7
1 7.7
daytime 7.7
married 7.7
blurred 7.7
profession 7.7
bouquet 7.5
house 7.5
one 7.5
blur 7.4
jacket 7.4
care 7.4
aged 7.2
case 7.1

Google
created on 2022-01-23

Smile 90.1
Sleeve 87.2
Tints and shades 76.4
Monochrome photography 74
Monochrome 72.9
Vintage clothing 71.1
Picture frame 70.3
Classic 69.7
Event 67.6
Room 65
Art 64
Sitting 63.9
Rectangle 61.8
Hat 59.4
History 59.4
Photographic paper 58.8
Photo caption 53.3
Portrait 53.2
Retro style 53
Font 52.3

Microsoft
created on 2022-01-23

text 99.3
human face 96.2
clothing 96.1
smile 94.1
person 93.9
posing 89.1
window 84.3
wedding dress 81.1
wedding 80.5
man 74.5
bride 70.5
white 63.1
old 55.6
picture frame 31.3

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 87.8%
Calm 99.6%
Surprised 0.2%
Sad 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 95.3%
Happy 3.3%
Confused 0.7%
Surprised 0.4%
Disgusted 0.1%
Angry 0.1%
Sad 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 86.5%
an old photo of a man and woman posing for a picture 75.9%
a man and woman posing for a photo 68.2%

Text analysis

Amazon

nezos