Human Generated Data

Title

Untitled (large family portrait at bar mitzvah)
Date

c. 1950
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21586

Human Generated Data

Title

Untitled (large family portrait at bar mitzvah)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21586

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Tie 99.8
Accessories 99.8
Accessory 99.8
Person 99.6
Human 99.6
Person 99.1
Person 99.1
Person 99
Person 98.9
Person 98.5
Clothing 98.1
Apparel 98.1
Person 97.5
Shorts 97.2
Person 96
Person 95.9
Person 95.1
Person 94.8
Person 92.2
Person 89.8
Person 89.7
Floor 89.2
Person 88.3
Person 81.1
Person 78.2
Person 74.7
Flooring 67.9
Crowd 66.8
Indoors 65.5
Portrait 62.1
Photography 62.1
Face 62.1
Photo 62.1
Chess 60.6
Game 60.6
Suit 59.5
Coat 59.5
Overcoat 59.5
Chair 57.9
Furniture 57.9
Shoe 57.1
Footwear 57.1

Clarifai
created on 2023-10-22

people 99.9
group together 99.6
many 99
group 97.7
woman 97.4
adult 97.1
man 96.7
recreation 95.9
several 91.2
leader 89.1
school 88.9
outfit 88.6
education 88.2
wear 87.9
child 87.3
uniform 87.3
position 87.1
five 83.2
victory 77.5
athlete 77.2

Imagga
created on 2022-03-05

man 40.8
person 37.1
people 36.2
male 35.4
businessman 30
business 26.1
group 25.8
adult 25.5
happy 22.5
men 22.3
professional 21.2
women 20.5
team 19.7
lifestyle 19.5
together 19.3
smiling 18.8
office 18.6
student 18.3
room 17.4
worker 17
casual 16.1
couple 15.7
portrait 15.5
success 15.3
spectator 15.1
meeting 15.1
job 15
work 14.9
mature 14.9
boy 14.8
life 14.7
cheerful 14.6
businesswoman 14.5
happiness 14.1
standing 13.9
smile 13.5
classroom 13
corporate 12.9
sitting 12.9
suit 12.7
communication 12.6
desk 12.3
friends 12.2
table 12.1
teamwork 12
executive 12
outdoors 11.9
nurse 11.6
confident 10.9
handsome 10.7
modern 10.5
attractive 10.5
fun 10.5
looking 10.4
manager 10.2
teacher 10.2
day 10.2
occupation 10.1
building 9.6
diversity 9.6
chair 9.6
businesspeople 9.5
love 9.5
two 9.3
human 9
school 8.9
family 8.9
child 8.7
run 8.7
athlete 8.6
holiday 8.6
talking 8.5
beach 8.4
color 8.3
health 8.3
employee 8.3
silhouette 8.3
holding 8.2
competition 8.2
computer 8.2
exercise 8.2
fitness 8.1
enrollee 8.1
sport 8.1
working 7.9
indoors 7.9
education 7.8
blackboard 7.8
colleagues 7.8
class 7.7
pretty 7.7
active 7.7
friendship 7.5
runner 7.5
vacation 7.4
successful 7.3
kin 7.3
entrepreneur 7.2
summer 7.1
sea 7

Google
created on 2022-03-05

Shorts 91.2
Human 89.6
Black-and-white 86.6
Style 84
Font 79.9
People 78.8
Monochrome 77.4
Indoor games and sports 76.7
Monochrome photography 76.6
Flooring 76.2
Leisure 73.6
Fun 72.9
Recreation 72.8
Ball 72.5
Event 72.3
Sports 72.2
Competition event 72
Sports equipment 71.4
Team 71.4
Room 71.1

Microsoft
created on 2022-03-05

floor 98.7
person 98.5
clothing 94.9
man 92.9
black 83.6
group 78.4
footwear 72.4
baseball 68.2
posing 61.4
black and white 60.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 62.7%
Surprised 21.2%
Sad 5.2%
Happy 4%
Confused 3.2%
Angry 2.2%
Disgusted 1.1%
Fear 0.4%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 53.3%
Happy 30.9%
Sad 5.7%
Surprised 4.7%
Disgusted 2.2%
Angry 1.7%
Confused 1.1%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Male, 84.5%
Sad 54.7%
Happy 18.4%
Calm 11.6%
Confused 4.3%
Fear 3.8%
Disgusted 3.6%
Angry 2.2%
Surprised 1.3%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Sad 81.7%
Calm 16.5%
Confused 0.4%
Happy 0.4%
Disgusted 0.3%
Surprised 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Male, 90.6%
Calm 54.3%
Sad 29%
Disgusted 7.1%
Fear 4.4%
Confused 2%
Happy 1.4%
Angry 0.9%
Surprised 0.9%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Confused 78.9%
Sad 7.8%
Calm 4.6%
Surprised 3.9%
Happy 1.6%
Disgusted 1.5%
Fear 1.1%
Angry 0.6%

AWS Rekognition

Age 50-58
Gender Male, 98.2%
Calm 93.3%
Happy 5.2%
Disgusted 0.4%
Surprised 0.3%
Confused 0.3%
Sad 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 97.2%
Happy 1.3%
Surprised 0.6%
Sad 0.3%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 87.3%
Sad 8%
Confused 1.1%
Disgusted 1%
Angry 0.9%
Surprised 0.7%
Happy 0.7%
Fear 0.3%

AWS Rekognition

Age 45-51
Gender Male, 100%
Happy 30%
Confused 24.6%
Sad 19.8%
Angry 9.7%
Surprised 6.6%
Calm 4.1%
Disgusted 3.6%
Fear 1.6%

AWS Rekognition

Age 41-49
Gender Male, 92.4%
Surprised 30.6%
Sad 29.1%
Calm 25.6%
Disgusted 4.2%
Fear 3.5%
Happy 2.9%
Confused 2.5%
Angry 1.6%

AWS Rekognition

Age 54-62
Gender Male, 97.4%
Sad 46.2%
Calm 25.9%
Surprised 8.9%
Confused 6.6%
Happy 5.4%
Disgusted 3%
Fear 2.7%
Angry 1.3%

AWS Rekognition

Age 45-51
Gender Male, 99.5%
Calm 39.9%
Sad 21.1%
Fear 8.8%
Confused 8.6%
Surprised 8.2%
Disgusted 8.1%
Happy 3.8%
Angry 1.4%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 51.2%
Calm 28.3%
Sad 9.2%
Confused 6.4%
Angry 1.9%
Disgusted 1.7%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 33.7%
Sad 26.3%
Confused 13.3%
Disgusted 9.5%
Surprised 6.1%
Fear 5.4%
Angry 3.2%
Happy 2.6%

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Calm 83.6%
Happy 14.5%
Confused 0.5%
Surprised 0.4%
Disgusted 0.4%
Sad 0.4%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 39-47
Gender Male, 97%
Calm 92%
Happy 6.8%
Confused 0.4%
Sad 0.3%
Disgusted 0.2%
Surprised 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Shoe
Tie 99.8%
Person 99.6%
Person 99.1%
Person 99.1%
Person 99%
Person 98.9%
Person 98.5%
Person 97.5%
Person 96%
Person 95.9%
Person 95.1%
Person 94.8%
Person 92.2%
Person 89.8%
Person 89.7%
Person 88.3%
Person 81.1%
Person 78.2%
Person 74.7%
Shoe 57.1%

Text analysis

Amazon

32
Adde
D Adde
D
i