Human Generated Data

Title

Untitled (family portrait on lawn outside house)
Date

1935
People

Artist: Hamblin Studio, American active 1930s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1912

Human Generated Data

Title

Untitled (family portrait on lawn outside house)

People

Artist: Hamblin Studio, American active 1930s

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1912

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.5
Human 98.5
Person 97.9
Person 97.6
Person 97.1
Person 97.1
Person 96.8
Person 96.7
Person 95.6
Clothing 94.1
Apparel 94.1
People 93.8
Person 92.8
Person 92.6
Person 92.4
Person 91.1
Person 91
Person 90.6
Poster 87.1
Advertisement 87.1
Person 86.6
Person 86.6
Person 86.5
Person 82.7
Person 82.4
Person 78.7
Person 78.3
Outdoors 75.5
Person 74.4
Female 71.4
Family 68
Housing 68
Building 68
Person 67.8
Person 67.4
Girl 66.6
Kid 64.1
Child 64.1
Yard 63.5
Nature 63.5
Face 58.8
Suit 58.8
Coat 58.8
Overcoat 58.8
Door 58.4
Dress 55.7

Clarifai
created on 2023-10-25

people 99.9
group 99.7
child 99.5
boy 97.1
many 97
education 96.3
family 95.5
man 95.1
group together 94.8
son 94.7
adult 94.1
woman 93.1
administration 92.1
portrait 89.9
school 89.2
wear 88.2
home 88
leader 83.4
outfit 82.4
adolescent 80.6

Imagga
created on 2021-12-14

shop 35.1
shoe shop 34.4
window 26.8
mercantile establishment 26.3
building 19.8
place of business 17.6
black 15.6
old 14.6
architecture 14
people 13.9
dress 12.6
man 12.4
interior 12.4
decoration 12.3
antique 10.7
style 10.4
person 10.2
house 10
art 10
vintage 9.9
framework 9.7
structure 9.6
home 9.6
door 9.3
establishment 8.8
holiday 8.6
elegant 8.6
school 8.5
portrait 8.4
elegance 8.4
traditional 8.3
city 8.3
indoor 8.2
family 8
child 7.7
fashion 7.5
tradition 7.4
supporting structure 7.3
girls 7.3
business 7.3
room 7.2
sliding door 7.2
history 7.1
working 7.1
modern 7

Google
created on 2021-12-14

Building 90.1
Picture frame 89.4
Dress 85.8
Window 85.7
Style 83.8
Black-and-white 82.2
House 75.8
Font 75.5
Monochrome photography 73.8
Monochrome 72.9
Musical instrument 72
Event 71.9
Art 71.7
Vintage clothing 66.8
History 65.4
Tree 64
Suit 64
Room 63.2
Stock photography 62
Team 60.7

Microsoft
created on 2021-12-14

text 97.5
window 96.9
house 92.3
person 91.1
clothing 85.6
posing 84.1
old 57

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 50-68
Gender Female, 95%
Calm 96.2%
Sad 1.3%
Surprised 0.8%
Angry 0.5%
Confused 0.5%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 31-47
Gender Male, 55.6%
Calm 90.2%
Happy 4.5%
Sad 1.9%
Surprised 1.6%
Confused 0.7%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 29-45
Gender Female, 90.2%
Calm 93.6%
Confused 2.2%
Surprised 2.1%
Happy 0.8%
Sad 0.5%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 33-49
Gender Female, 81.6%
Fear 56.8%
Happy 14.5%
Sad 14.4%
Calm 6%
Confused 3.5%
Surprised 2.7%
Disgusted 1.5%
Angry 0.6%

AWS Rekognition

Age 34-50
Gender Male, 99.1%
Confused 38.5%
Calm 31.5%
Angry 8.2%
Happy 6.2%
Sad 5.9%
Surprised 5.2%
Fear 3%
Disgusted 1.7%

AWS Rekognition

Age 52-70
Gender Female, 69.4%
Calm 83.4%
Sad 5.3%
Confused 3.5%
Angry 2.5%
Happy 2.4%
Surprised 1.6%
Disgusted 0.9%
Fear 0.4%

AWS Rekognition

Age 49-67
Gender Female, 52%
Calm 42.3%
Happy 40.9%
Surprised 8.7%
Confused 3.9%
Angry 2.7%
Disgusted 0.7%
Sad 0.7%
Fear 0.1%

AWS Rekognition

Age 34-50
Gender Male, 93.7%
Happy 88.3%
Calm 5.5%
Sad 2%
Confused 1.5%
Fear 1.2%
Surprised 0.6%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 43-61
Gender Male, 78.6%
Calm 79.3%
Happy 12.6%
Sad 4%
Confused 1.3%
Surprised 1.1%
Fear 1%
Angry 0.6%
Disgusted 0.2%

AWS Rekognition

Age 42-60
Gender Male, 80.9%
Sad 94.4%
Calm 4.4%
Confused 0.3%
Happy 0.3%
Fear 0.2%
Surprised 0.2%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 46-64
Gender Male, 87%
Calm 91.4%
Happy 6.6%
Angry 0.6%
Surprised 0.6%
Sad 0.3%
Disgusted 0.3%
Confused 0.2%
Fear 0%

AWS Rekognition

Age 27-43
Gender Female, 99.2%
Calm 47.2%
Happy 30.9%
Confused 17.3%
Sad 2.3%
Disgusted 0.8%
Surprised 0.8%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 39-57
Gender Female, 52.1%
Calm 65.9%
Sad 31.4%
Angry 0.9%
Happy 0.6%
Confused 0.5%
Fear 0.3%
Surprised 0.3%
Disgusted 0.1%

AWS Rekognition

Age 31-47
Gender Female, 99%
Calm 26.3%
Surprised 19.6%
Disgusted 15.3%
Fear 12.2%
Sad 10.5%
Angry 7.9%
Confused 6.5%
Happy 1.6%

AWS Rekognition

Age 48-66
Gender Male, 74.2%
Calm 90.4%
Happy 4.6%
Sad 3.1%
Surprised 0.5%
Disgusted 0.4%
Confused 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 40-58
Gender Male, 55.6%
Calm 61.1%
Happy 12.1%
Angry 9.7%
Surprised 6.5%
Sad 6.1%
Confused 2.1%
Fear 1.6%
Disgusted 0.7%

AWS Rekognition

Age 56-74
Gender Female, 66.4%
Calm 52.9%
Sad 28%
Confused 5.8%
Angry 4%
Happy 3.8%
Fear 3.4%
Surprised 1.4%
Disgusted 0.7%

AWS Rekognition

Age 28-44
Gender Male, 69.8%
Calm 69.5%
Happy 9.6%
Fear 7.4%
Confused 4.7%
Surprised 4.2%
Sad 2.6%
Disgusted 1%
Angry 1%

AWS Rekognition

Age 37-55
Gender Male, 58.6%
Calm 73.4%
Sad 11.2%
Happy 9.5%
Surprised 2.2%
Confused 1.6%
Angry 1.1%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 19-31
Gender Female, 94.8%
Calm 82.6%
Happy 10.5%
Sad 4%
Surprised 1.2%
Confused 0.9%
Fear 0.3%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 36-52
Gender Female, 78.2%
Calm 48.4%
Sad 19.7%
Happy 15.9%
Angry 4.6%
Confused 4.6%
Disgusted 2.7%
Fear 2.3%
Surprised 1.8%

AWS Rekognition

Age 31-47
Gender Female, 93.4%
Calm 94.8%
Surprised 2.4%
Happy 1.2%
Confused 0.6%
Sad 0.5%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Poster 87.1%

Categories

Imagga

streetview architecture 55.2%
interior objects 22.5%
paintings art 18.7%
text visuals 1.7%