Human Generated Data

Title

Untitled (elderly couple standing with three others at golden anniversary event)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9857

Human Generated Data

Title

Untitled (elderly couple standing with three others at golden anniversary event)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Apparel 99.8
Clothing 99.8
Human 99.2
Person 99.2
Person 98.6
Person 98
Person 96
Person 94.8
Home Decor 92.5
Furniture 86.9
Chair 86.9
Sleeve 81.2
Long Sleeve 81
Blossom 75.9
Plant 75.9
Flower 75.9
Coat 73.3
Suit 72.1
Overcoat 72.1
Flower Arrangement 65.6
Indoors 65.1
Shirt 63.9
Female 61.8
Linen 59.9
Flower Bouquet 58.7
Photo 58
Photography 58
Door 56.5
Bed 55.9
Dress 55.8
Clinic 55.5

Imagga
created on 2022-01-28

nurse 50.1
man 43.7
male 42.6
people 36.3
person 35
team 34.1
adult 34
businessman 30.9
happy 30.7
professional 30.7
business 29.8
executive 28.6
men 28.4
doctor 28.2
office 27.3
medical 26.5
hospital 25.7
colleagues 25.3
teamwork 25
group 24.2
indoors 23.7
mature 23.3
job 23
meeting 22.6
patient 21.9
businesspeople 21.8
smiling 21.7
worker 21.7
senior 20.6
corporate 20.6
elderly 20.1
clinic 20
30s 19.3
women 18.2
businesswoman 18.2
portrait 18.1
care 18.1
work 18.1
casual 17.8
health 17.4
happiness 17.3
working 16.8
lab coat 16.8
medicine 16.7
camera 16.6
mid adult 16.4
looking 16
home 16
coat 15.8
associates 15.7
couple 15.7
smile 15.7
standing 15.7
lifestyle 15.2
together 14.9
occupation 14.7
cheerful 14.6
40s 14.6
clothing 14.3
talking 14.3
desk 14.2
groom 14
suit 12.9
success 12.9
20s 12.8
indoor 12.8
coworkers 12.8
stethoscope 12.7
clinical 12.7
partnership 12.5
handsome 12.5
ethnic 12.4
sitting 12
modern 11.9
successful 11.9
two 11.9
doctors 11.8
consultant 11.7
discussion 11.7
color 11.7
cooperation 11.6
staff 11.5
table 11.3
attractive 11.2
day 11
confident 10.9
discussing 10.8
50s 10.8
thirties 10.7
face 10.7
employee 10.6
illness 10.5
manager 10.3
laptop 10
specialist 10
kin 9.9
old 9.8
human 9.8
expertise 9.7
partner 9.7
four 9.6
horizontal 9.2
practitioner 9.2
business people 8.9
fifties 8.9
crew 8.9
30 35 years 8.8
good mood 8.8
60s 8.8
businessmen 8.8
half length 8.8
middle aged 8.8
surgeon 8.7
building 8.7
corporation 8.7
life 8.6
confidence 8.6
bright 8.6
adults 8.5
director 8.4
room 8.4
communication 8.4
company 8.4
inside 8.3
family 8
general practitioner 7.9
four people 7.9
gray hair 7.9
forties 7.9
25 30 years 7.8
handshake 7.8
physician 7.8
case 7.8
workers 7.8
diversity 7.7
expression 7.7
sick person 7.6
career 7.6
uniform 7.4
aged 7.2
computer 7.2

Google
created on 2022-01-28

Black 89.7
Black-and-white 86.5
Style 84
Monochrome photography 78.2
Monochrome 77
Snapshot 74.3
Art 73.6
Fashion design 73.1
Event 72.9
Picture frame 72.1
Formal wear 70.1
Vintage clothing 69.3
Plant 69
Uniform 67.2
Room 67
Stock photography 64.4
White-collar worker 62.4
Font 62
Suit 60.9
Table 60.5

Microsoft
created on 2022-01-28

person 99.1
clothing 95.6
standing 95.1
wedding 91.9
text 87.4
smile 87.1
dress 83.8
man 83
woman 81.1
posing 68.3
group 66.1
wedding dress 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.2%
Calm 97.3%
Happy 1.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%
Sad 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 50.8%
Calm 99.8%
Sad 0.2%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Female, 97.4%
Calm 98.2%
Sad 0.9%
Happy 0.7%
Surprised 0.1%
Fear 0.1%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 45-51
Gender Male, 98%
Confused 66.7%
Sad 22.2%
Happy 4.4%
Calm 2.9%
Disgusted 1.3%
Fear 0.9%
Surprised 0.8%
Angry 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo 97.8%
a person standing in front of a group of people posing for a photo 94%
a group of people posing for the camera 93.9%

Text analysis

Amazon

2
S

Google

S
220 S
220