Human Generated Data

Title

Untitled (family portrait, in front of clapboard house)
Date

1958
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18849

Human Generated Data

Title

Untitled (family portrait, in front of clapboard house)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18849

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.5
Apparel 99.5
Person 99.3
Human 99.3
Person 99.3
Person 99.1
Person 99.1
Shorts 99.1
Person 97.7
Person 97.6
Person 97.5
Person 97.5
Person 97.5
Person 97.3
Person 97.2
Shelter 97.1
Building 97.1
Rural 97.1
Outdoors 97.1
Nature 97.1
Countryside 97.1
Person 95.8
Person 93.5
Person 92.7
Person 86.4
Female 83.5
Tie 83.3
Accessories 83.3
Accessory 83.3
Crowd 82.5
Person 81.2
Car 75.2
Transportation 75.2
Vehicle 75.2
Automobile 75.2
Person 73.3
Skirt 72.4
People 70.4
Girl 64.8
Woman 62.6
Kid 59.3
Child 59.3
Dress 59
Walking 55.2

Clarifai
created on 2023-10-22

people 100
many 99.5
group together 99.4
child 98.8
group 98.7
woman 97.6
adult 96.6
man 96.4
recreation 94.3
boy 92.8
school 90.3
education 88.6
several 88.6
adolescent 88.3
street 87.9
uniform 83.4
crowd 83.1
five 82.1
wear 81.7
family 81.4

Imagga
created on 2022-03-05

runner 91.1
athlete 91
contestant 49.9
sport 46.8
person 38.1
people 29.6
man 27.5
run 25.1
exercise 23.6
competition 22.9
ball 21.7
active 21.5
fitness 20.8
street 20.2
running 19.2
men 18.9
lifestyle 18.8
outdoors 18
action 17.6
city 17.4
adult 17
male 15.6
motion 15.4
recreation 15.2
walking 15.1
healthy 15.1
couple 13.9
sports 13.9
jogging 13.8
summer 13.5
track 13.5
happy 13.2
training 12.9
speed 12.8
playing 12.8
fun 12.7
grass 12.6
player 12.6
activity 12.5
urban 12.2
women 11.9
health 11.8
court 11.7
game 11.6
athletic 11.5
outdoor 11.5
child 11.4
play 11.2
fit 11
team 10.7
pedestrian 10.5
race 10.5
group 10.5
smiling 10.1
determination 9.8
exercising 9.6
walk 9.5
legs 9.4
outside 9.4
field 9.2
black 9
human 9
rush 8.8
train 8.8
life 8.8
tennis 8.8
boy 8.7
crowd 8.6
happiness 8.6
foot 8.6
equipment 8.6
business 8.5
two 8.5
dress 8.1
cheerful 8.1
body 8
together 7.9
jog 7.9
players 7.9
athletics 7.9
smile 7.8
compete 7.8
portrait 7.8
practice 7.7
move 7.7
blurred 7.7
workout 7.6
fashion 7.5
joy 7.5
senior 7.5
school 7.3
spectator 7.3
success 7.2
road 7.2
professional 7.1
day 7.1

Google
created on 2022-03-05

Black 89.6
Black-and-white 86.9
Style 84
Dress 83.4
Monochrome photography 79.6
Adaptation 79.4
Monochrome 78.2
Suit 76
Window 72.6
Event 71.7
Vintage clothing 69.2
Team 67.7
Room 67.3
History 66.2
Stock photography 63.2
Photo caption 62.9
Building 57.7
Child 57.3
Photographic paper 57.1
Plant 56.8

Microsoft
created on 2022-03-05

building 99.2
clothing 98.9
person 96.5
footwear 92.5
man 90.4
outdoor 89.2
woman 82.6
group 76.7
people 74.6
black and white 71.9
text 66.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 66.6%
Sad 19.7%
Confused 4.3%
Happy 2.9%
Disgusted 2.2%
Angry 1.7%
Surprised 1.4%
Fear 1.4%

AWS Rekognition

Age 47-53
Gender Male, 96.9%
Happy 97.1%
Calm 1.6%
Surprised 0.6%
Disgusted 0.4%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Sad 0.1%

AWS Rekognition

Age 23-31
Gender Female, 51.1%
Calm 91%
Confused 2.8%
Fear 1.9%
Angry 1.3%
Surprised 1%
Happy 0.8%
Sad 0.6%
Disgusted 0.5%

AWS Rekognition

Age 20-28
Gender Female, 98.6%
Calm 78.6%
Happy 18.7%
Surprised 1.3%
Sad 0.7%
Confused 0.3%
Angry 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 45-53
Gender Female, 77.8%
Happy 97.8%
Calm 1.9%
Surprised 0.2%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 30-40
Gender Male, 98.2%
Calm 86.3%
Angry 5.4%
Happy 3.3%
Sad 2.2%
Surprised 1.4%
Confused 0.8%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 41-49
Gender Male, 99.7%
Calm 99.6%
Surprised 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 54.9%
Calm 79.5%
Fear 6%
Surprised 5.4%
Confused 4.2%
Sad 2%
Disgusted 1.8%
Angry 0.8%
Happy 0.4%

AWS Rekognition

Age 51-59
Gender Female, 99.7%
Happy 59.5%
Calm 29.5%
Sad 4.8%
Surprised 4.3%
Confused 0.8%
Angry 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Female, 89.4%
Calm 68.9%
Happy 24.7%
Surprised 3.9%
Disgusted 0.7%
Sad 0.6%
Fear 0.5%
Confused 0.5%
Angry 0.3%

AWS Rekognition

Age 45-51
Gender Female, 96.6%
Calm 80%
Happy 15.5%
Disgusted 1.3%
Sad 1.2%
Confused 0.9%
Fear 0.5%
Surprised 0.3%
Angry 0.3%

AWS Rekognition

Age 42-50
Gender Male, 99.7%
Calm 87.4%
Surprised 9.4%
Happy 2.6%
Confused 0.2%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Car
Person 99.3%
Person 99.3%
Person 99.1%
Person 99.1%
Person 97.7%
Person 97.6%
Person 97.5%
Person 97.5%
Person 97.5%
Person 97.3%
Person 97.2%
Person 95.8%
Person 93.5%
Person 92.7%
Person 86.4%
Person 81.2%
Person 73.3%
Tie 83.3%
Car 75.2%

Categories

Imagga

streetview architecture 56.6%
nature landscape 39.8%
pets animals 2.2%

Text analysis

Amazon

R
-
Pow
MJ17--YT37A--

Google

IR
IR