Human Generated Data

Title

Untitled (family portrait outside)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21643

Human Generated Data

Title

Untitled (family portrait outside)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21643

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Furniture 100
Person 99.4
Human 99.4
Clothing 99.4
Apparel 99.4
Person 99.3
Person 99
Person 96.6
Shorts 95.4
Person 91.3
People 89.4
Shoe 87.5
Footwear 87.5
Face 87.4
Shelter 76.6
Countryside 76.6
Building 76.6
Rural 76.6
Outdoors 76.6
Nature 76.6
Chair 76.6
Shoe 72.7
Portrait 69.7
Photography 69.7
Photo 69.7
Sitting 68.3
Suit 67.4
Coat 67.4
Overcoat 67.4
Pants 64.4
Man 63.3
Kid 62.3
Child 62.3
Table 62
Plant 61.6
Smile 59.6
Female 58.7
Shirt 58.4
Urban 57.3
Dining Table 56.9

Clarifai
created on 2023-10-22

people 99.9
group 99.6
adult 98.5
woman 97.7
group together 97.6
child 97.3
man 96.8
three 95.1
portrait 94.7
sibling 94.7
family 94.6
offspring 94.4
actor 94.4
four 94.3
wear 92.5
son 92
several 91.1
two 90.8
leader 90.7
chair 89.7

Imagga
created on 2022-03-05

kin 39.4
beach 35.7
man 30.2
silhouette 29.8
sunset 28.8
people 27.9
sea 26.6
ocean 26.2
sky 25.5
water 24
sand 22.6
summer 19.9
male 19.7
vacation 19.6
relax 19.4
couple 19.2
child 18.5
outdoors 17.4
person 17.3
shore 16.8
sun 16.1
travel 15.5
outdoor 15.3
adult 14.5
coast 14.4
dusk 14.3
love 14.2
happiness 14.1
lifestyle 13.7
walking 13.3
sport 13.3
happy 13.2
men 12.9
landscape 12.6
chair 12.6
romantic 12.5
together 12.3
waves 12.1
two 11.9
life 11.7
family 11.6
holiday 11.5
evening 11.2
sitting 11.2
clouds 11
tourism 10.7
group 10.5
walk 10.5
day 10.2
active 10
leisure 10
fun 9.7
sunny 9.5
tourist 9.2
calm 9.1
freedom 9.1
romance 8.9
dawn 8.7
pedestrian 8.6
youth 8.5
tropical 8.5
business 8.5
relaxation 8.4
field 8.4
joy 8.4
lake 8.2
relaxing 8.2
mountain 8
businessman 7.9
women 7.9
pier 7.9
parent 7.9
boy 7.8
father 7.7
outside 7.7
old 7.7
winter 7.7
sit 7.6
sunrise 7.5
brass 7.5
peace 7.3
scholar 7.3
grass 7.1
kid 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

outdoor 99.2
clothing 99.1
person 98.4
text 96.2
smile 93.9
man 92.2
footwear 86
human face 80.3
posing 76.4
crowd 0.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 7-17
Gender Female, 80.4%
Calm 65.3%
Happy 29.9%
Surprised 1.5%
Sad 1.2%
Fear 1%
Disgusted 0.4%
Confused 0.4%
Angry 0.2%

AWS Rekognition

Age 37-45
Gender Female, 55.2%
Calm 64.7%
Happy 33.7%
Sad 0.4%
Surprised 0.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.6%
Happy 91.1%
Calm 5.6%
Surprised 0.8%
Confused 0.8%
Disgusted 0.6%
Sad 0.5%
Fear 0.4%
Angry 0.2%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Happy 70.1%
Surprised 28.4%
Confused 0.5%
Fear 0.3%
Disgusted 0.3%
Calm 0.2%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 30-40
Gender Male, 55.8%
Happy 99.2%
Calm 0.4%
Surprised 0.2%
Confused 0.1%
Fear 0.1%
Sad 0%
Disgusted 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Chair
Person 99.4%
Person 99.3%
Person 99%
Person 96.6%
Person 91.3%
Shoe 87.5%
Shoe 72.7%
Chair 76.6%

Text analysis

Amazon

a
MJI7
321-1
MJI7 YE33A 002NA
002NA
YE33A

Google

MJ YT33A2 022A
MJ
YT33A2
022A