Human Generated Data

Title

Untitled (old couple posed by piano in living room)

Date

1954

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9508

Human Generated Data

Title

Untitled (old couple posed by piano in living room)

People

Artist: Martin Schweig, American 20th century

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Tie 99.8
Accessory 99.8
Accessories 99.8
Clothing 98.8
Apparel 98.8
Person 97.8
Human 97.8
Furniture 96.8
Interior Design 96.1
Indoors 96.1
Chair 92.5
Leisure Activities 84.5
Person 84.3
Female 81.1
Face 81
Musical Instrument 72.6
Piano 72.6
Suit 70.4
Overcoat 70.4
Coat 70.4
Photography 67.3
Portrait 67.3
Photo 67.3
Woman 66
Table 63.9
Dress 62.9
Bed 62.9
Clinic 60.6
Girl 60.2
Sleeve 57.9
Glasses 56.7
Blossom 55.4
Flower 55.4
Plant 55.4
Grand Piano 55.2
Table Lamp 55
Lamp 55

Imagga
created on 2022-01-28

person 43
adult 42.4
man 42.4
businessman 38.9
office 37.8
people 36.3
male 36.2
business 34.6
professional 34.4
computer 31.4
nurse 30.5
room 27.6
businesspeople 27.5
indoors 26.4
working 25.7
businesswoman 25.5
patient 25.1
desk 24.9
meeting 24.5
teacher 23.8
indoor 23.8
work 23.6
hospital 23.5
colleagues 23.3
laptop 22.8
happy 22.6
men 22.3
job 22.1
table 21.9
smiling 21.7
sitting 21.5
casual 20.4
group 20.2
team 19.7
worker 19.1
corporate 18.9
executive 18.6
specialist 18.4
home 18.4
lifestyle 18.1
face 17.8
teamwork 16.7
educator 16.4
life 16.3
coworkers 15.7
smile 15.7
portrait 15.5
talking 15.2
associates 14.8
women 14.2
medical 14.1
doctor 14.1
cheerful 13.8
20s 13.8
handsome 13.4
health 13.2
manager 13
occupation 12.8
looking 12.8
conference 12.7
suit 12.6
communication 12.6
mid adult 12.6
30s 12.5
bright 12.2
mature 12.1
attractive 11.9
groom 11.8
confident 11.8
happiness 11.8
color 11.7
together 11.4
couple 11.3
keyboard 11.3
senior 11.3
horizontal 10.9
crew 10.8
40s 10.7
care 10.7
hand 10.6
illness 10.5
technology 10.4
salon 10.3
house 10
explaining 9.8
25 30 years 9.8
interior 9.7
expertise 9.7
busy 9.6
elderly 9.6
sick person 9.5
education 9.5
bed 9.5
case 9.5
day 9.4
successful 9.2
modern 9.1
pretty 9.1
document 9
student 9
success 8.9
medicine 8.8
businessmen 8.8
paper 8.7
staff 8.6
boss 8.6
clothing 8.5
career 8.5
clinic 8.4
focus 8.3
discussion 7.8
jacket 7.7
expression 7.7
four 7.7
formal 7.6
uniform 7.6
females 7.6
sit 7.6
human 7.5
screen 7.5
shirt 7.5
presentation 7.5
company 7.4
coat 7.4
hall 7.4
employee 7.4
phone 7.4
light 7.4
board 7.2

Google
created on 2022-01-28

Black 89.6
Standing 86.4
Dress 84.5
Style 83.8
Chair 83.2
Table 82.4
Black-and-white 82.3
Fashion design 75.4
Monochrome photography 72.6
Room 70.6
Vintage clothing 70.5
Monochrome 69.9
Event 69.8
Keyboard 68.8
Piano 67.8
Classic 65.6
Hat 65.5
Stock photography 63.6
Machine 62.8
Sitting 61.7

Microsoft
created on 2022-01-28

person 97.9
man 93.8
text 90.4
furniture 89.5
table 62.5
posing 57.4
old 45.3

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Male, 99.7%
Happy 61.6%
Sad 13.6%
Angry 7.4%
Confused 6%
Surprised 3.6%
Disgusted 3.4%
Fear 2.5%
Calm 1.9%

AWS Rekognition

Age 47-53
Gender Male, 82.2%
Calm 76.3%
Sad 17.2%
Happy 3.4%
Fear 1.4%
Disgusted 0.7%
Confused 0.5%
Surprised 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.8%
Person 97.8%

Captions

Microsoft

an old photo of a man 90.3%
a man standing in front of a window 78.6%
old photo of a man 78.5%

Text analysis

Amazon

тза
saise

Google

YT3RA°2-A
YT3RA°2-A