Human Generated Data

Title

Untitled (older couple posing by holiday food table in dining room)

Date

1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9536

Human Generated Data

Title

Untitled (older couple posing by holiday food table in dining room)

People

Artist: Martin Schweig, American 20th century

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.3
Person 99.3
Person 98.4
Meal 92.4
Food 92.4
Tie 90
Accessories 90
Accessory 90
Cream 89.5
Cake 89.5
Dessert 89.5
Icing 89.5
Creme 89.5
Furniture 82.4
Chair 82.4
Dish 80.7
People 80.5
Clothing 76.1
Apparel 76.1
Table 66.3
Indoors 63.9
Flower 62.2
Plant 62.2
Blossom 62.2
Room 57.6
Dining Table 55.8

Imagga
created on 2022-01-28

monitor 42.6
computer 38.3
laptop 34.7
man 32.9
office 30.8
person 29.3
electronic equipment 29.3
business 27.9
people 26.2
adult 26.1
television 25.1
male 24.8
happy 23.2
smiling 22.4
sitting 22.3
businessman 22.1
equipment 21.5
desk 20.9
corporate 20.6
professional 19.8
table 19.5
working 19.4
indoors 19.3
work 18.9
technology 18.6
smile 17.8
executive 16.4
lifestyle 15.9
suit 15.3
businesspeople 15.2
communication 15.1
modern 14.7
businesswoman 14.5
looking 14.4
handsome 14.3
attractive 14
notebook 13.8
men 13.7
casual 13.6
lab coat 13.3
coat 12.9
success 12.9
happiness 12.5
job 12.4
cheerful 12.2
home 12
broadcasting 11.9
worker 11.7
portrait 11.6
meeting 11.3
kitchen 11
indoor 11
face 10.7
pretty 10.5
room 10.5
one 10.5
education 10.4
senior 10.3
women 10.3
manager 10.2
day 10.2
color 10
confident 10
screen 9.9
interior 9.7
together 9.6
using 9.6
standing 9.6
keyboard 9.4
mature 9.3
bright 9.3
horizontal 9.2
house 9.2
hand 9.1
clothing 9
group 8.9
telecommunication 8.9
colleagues 8.7
mid adult 8.7
busy 8.7
workplace 8.6
blackboard 8.5
telecommunication system 8.5
contemporary 8.5
20s 8.2
occupation 8.2
alone 8.2
typing 7.8
concentration 7.7
corporation 7.7
30s 7.7
expression 7.7
wireless 7.6
talking 7.6
joy 7.5
shirt 7.5
teamwork 7.4
focus 7.4
successful 7.3
team 7.2
classroom 7.1

Google
created on 2022-01-28

Black 89.7
Chair 86.4
Coat 85.9
Style 83.9
Black-and-white 83.7
Table 81.1
Art 78.5
Suit 77.6
Picture frame 75.4
Vintage clothing 72.4
Monochrome photography 72.2
Curtain 71.5
Monochrome 70.3
Event 69
Classic 65.7
Room 65.6
Painting 64.8
Visual arts 63.8
Stock photography 63.3
Rectangle 62.5

Microsoft
created on 2022-01-28

clothing 91.9
indoor 91.7
person 91.3
text 85.2
man 83.3
old 68.6
white 64.8

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 100%
Happy 72.6%
Surprised 20.4%
Fear 2.5%
Sad 1.1%
Disgusted 1%
Calm 1%
Angry 0.8%
Confused 0.7%

AWS Rekognition

Age 42-50
Gender Male, 94%
Happy 47.7%
Calm 47%
Sad 2.3%
Confused 1%
Disgusted 0.6%
Surprised 0.6%
Angry 0.6%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 90%
Chair 82.4%

Captions

Microsoft

an old photo of a person 91.9%
old photo of a person 91.1%
an old photo of a man and a woman standing in a room 83.4%

Text analysis

Amazon

50
HAJ3
MJI7--YT37A--X

Google

MJI7--YT37A°2
50
XAGON
50 MJI7--YT37A°2 - - XAGON
-