Human Generated Data

Title

Untitled (young couple posing with servant in dining room)
Date

1960
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9742

Human Generated Data

Title

Untitled (young couple posing with servant in dining room)

People

Artist: Martin Schweig, American 20th century

Date

1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9742

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Clothing 99.7
Apparel 99.7
Person 99.7
Human 99.7
Person 99.6
Person 98.4
Shorts 91.9
Shoe 90.6
Footwear 90.6
Chair 89.7
Furniture 89.7
Suit 89.4
Coat 89.4
Overcoat 89.4
Female 82.5
Dress 81.4
Shirt 73.9
Shoe 71
Woman 67.8
Portrait 62.9
Face 62.9
Photography 62.9
Photo 62.9
Advertisement 58.1
Flower 58
Plant 58
Blossom 58
Tuxedo 57.1
Shoe 57
Shoe 56.5

Clarifai
created on 2023-10-27

people 99.9
group 97.9
man 95.7
family 95
woman 93.8
adult 92.8
two 92.6
three 92.1
actor 89.1
child 87.9
leader 87
monochrome 86.1
room 84.1
wear 83.7
wedding 80.6
indoors 79.6
interaction 79.5
four 78.5
dress 78.5
group together 78.3

Imagga
created on 2022-01-24

people 29.5
man 26.9
person 21.7
kin 21
male 20.6
child 16.9
happy 15.7
team 15.2
sibling 15.1
silhouette 12.4
group 12.1
adult 12
work 11.8
childhood 11.6
black 11.4
teamwork 11.1
world 11
happiness 11
business 10.9
smiling 10.8
job 10.6
businessman 10.6
crowd 10.6
fun 10.5
men 10.3
women 10.3
blond 9.6
together 9.6
couple 9.6
active 9.5
lifestyle 9.4
holiday 9.3
grandfather 9.1
playing 9.1
portrait 9.1
human 9
family 8.9
sexy 8.8
grandma 8.7
standing 8.7
love 8.7
joy 8.3
occupation 8.2
cheerful 8.1
activity 8.1
looking 8
body 8
kid 8
school 7.9
smile 7.8
sitting 7.7
expression 7.7
youth 7.7
casual 7.6
walking 7.6
fashion 7.5
friendship 7.5
outdoors 7.5
symbol 7.4
daughter 7.4
success 7.2
cute 7.2
summer 7.1
day 7.1

Google
created on 2022-01-24

Coat 87.2
Black-and-white 85.3
Gesture 85.3
Style 83.9
Dress 83.8
Line 81.8
Adaptation 79.3
Overcoat 78.5
Picture frame 77.7
Monochrome photography 76.5
Monochrome 75.9
Art 75.8
Vintage clothing 73.6
Event 70.8
Duster 69.9
Room 67.7
Visual arts 65
Stock photography 62.1
Font 61.2
History 61.2

Microsoft
created on 2022-01-24

clothing 96.6
text 95.9
person 93.3
dress 92.8
woman 84.8
footwear 84.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99%
Calm 100%
Happy 0%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 54-64
Gender Male, 99.6%
Surprised 36.3%
Sad 21.2%
Calm 13.6%
Happy 12.1%
Confused 7.8%
Disgusted 3.6%
Fear 2.8%
Angry 2.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Chair
Person 99.7%
Person 99.6%
Person 98.4%
Shoe 90.6%
Shoe 71%
Shoe 57%
Shoe 56.5%
Chair 89.7%

Text analysis

Amazon

20215
MJ17--YT37A°S- -X

Google

2 21 MJI7-- YT37A°2 -- XAGO
2
21
MJI7--
YT37A°2
--
XAGO