Human Generated Data

Title

Untitled (two women and two men chatting on couch in Christmas living room)

Date

1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9533

Human Generated Data

Title

Untitled (two women and two men chatting on couch in Christmas living room)

People

Artist: Martin Schweig, American 20th century

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.6
Human 99.6
Person 99.6
Clothing 99.3
Apparel 99.3
Person 99
Person 98.9
Shorts 88.6
Person 81.7
People 77.5
Tie 77.5
Accessories 77.5
Accessory 77.5
Person 76.6
Furniture 74.9
Chair 74.9
Suit 71.8
Overcoat 71.8
Coat 71.8
Sunglasses 68.8
Plant 68.7
Text 67.5
Female 66.4
Sailor Suit 64.4
Food 63.6
Dessert 63.6
Cream 63.6
Creme 63.6
Icing 63.6
Cake 63.6
Photography 61.3
Photo 61.3
Shirt 59.9
Blossom 59.4
Flower 59.4
Face 59.1

Imagga
created on 2022-01-28

man 32.9
people 30.1
male 27.7
person 27.3
silhouette 21.5
adult 19.5
men 18.9
couple 18.3
sunset 18
group 15.3
kin 15.2
love 15
businessman 14.1
life 13.9
outdoor 13.8
beach 13.5
sport 13.4
world 12.9
portrait 12.9
summer 12.9
business 12.8
happy 12.5
sky 12.1
team 11.6
black 11.4
together 11.4
happiness 11
active 10.9
athlete 10.8
water 10.7
newspaper 10.7
job 10.6
walking 10.4
work 10.2
wind instrument 10.2
lifestyle 10.1
musical instrument 9.9
vacation 9.8
brass 9.8
sun 9.7
success 9.7
women 9.5
professional 9.4
smiling 9.4
friendship 9.4
suit 9.2
human 9
fun 9
outdoors 9
romantic 8.9
family 8.9
bow tie 8.9
office 8.8
player 8.3
guy 8.3
park 8.2
worker 8.2
romance 8
sand 8
contestant 7.8
boy 7.8
sea 7.8
corporate 7.7
bride 7.7
married 7.7
old 7.7
dusk 7.6
two 7.6
walk 7.6
product 7.5
senior 7.5
relationship 7.5
leisure 7.5
ocean 7.5
action 7.4
groom 7.4
child 7.3
exercise 7.3
photographer 7.2
room 7.1
necktie 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.1
clothing 97.4
outdoor 95.1
person 95
man 91.5
footwear 77.4
posing 62.9
smile 52.8
old 48.6

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 94.6%
Calm 97.4%
Sad 1.8%
Surprised 0.5%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 48-56
Gender Male, 100%
Happy 97.8%
Surprised 1.1%
Calm 0.5%
Confused 0.2%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 77.5%
Sunglasses 68.8%

Captions

Microsoft

a group of people posing for a photo 90.7%
a group of people posing for a picture 90.6%
a group of people posing for the camera 90.5%

Text analysis

Google

A°2--XA00
A°2--XA00